1 Prerequisites

Before we even start, it is of crucial importance to first understand deeply linear and logistic regression. This is because (as we will see in later discussion) they are the very basic components in a general neural network model.

1.1 Linear Regression

A linear model can be written in a matrix form

\[ Y = X\beta + \epsilon, \]

where \(Y\) is the output or label vector of length \(N\) (number of observations), \(X\) is the input feature matrix (referred to as the design matrix in statistics) with dimension \(N\) by \(P\) (number of features), \(\beta\) is the model weights/coefficients (a column vector of length \(P\)) for which we’d like to solve, \(\epsilon\) is the model residual or error vector.

1.1.1 Ordinary Least Squares

The classical way to solve for \(\beta\) is ordinary least squares. The idea of OLS is find out the weights that minimize the mean of squared model errors:

\[ \begin{aligned} \mbox{mse (loss)} &= \frac{1}{N}\sum_i\epsilon^2_i \\ &= \frac{1}{N}\sum_i(y_i - \beta x_i)^2, \end{aligned} \]

where \(y_i\) and \(x_i\) is the \(i\)-th observation. The first-order condition (requiring that the first-order derivative w.r.t. weights are all zero) gives us the OLS solution for model weights \(\beta\) analytically (in matrix notation):

\[ \begin{equation} \label{eq:ols} \hat{\beta} = (X'X)^{-1}X'Y. \end{equation} \]

Let’s consider a toy model with only one non-constant feature:

\[ y_i = 6 + 4x_i + \epsilon_i. \]

In this model the outcome \(y\) is determined by a bias term plus a single variable \(x\), with an independently distributed noise term \(\epsilon \sim \mbox{Normal}(0, 1)\).

Create some random data generated from this model:

Without consideration of the noise term, the OLS estimator will solve precisely for the true model weights:

Of course in the real world the noise term cannot be determined and usually the feature alone cannot explain entirely the variation in the outcome. This means that what we actually estimate will be the expected value of model weights:

We can check the result from sklearn:

By the Law of Large Number and Central Limit Theorem, under a relatively loose assumption of \(E(\epsilon | X) = 0\), the OLS estimator will converge in probability to the true model weights and distributed asymptotically Normal in large sample.1

The issue of the above approach is that equation \(\eqref{eq:ols}\) is not numerically stable when it comes to large-scale application where we may have lots of observations and lots of features. One very useful solution to solve the estimator numerically in large-scale application is the gradient descent approach.

1.1.2 Gradient Descent with Mean Squared Error

Instead of solving the first-order condition analytically, we can do it numerically. Gradient descent is a 1st-order optimization technique to find local optimum of a given function.

In the model training exercise our target function is the loss so the optimization problem is:

\[ \operatorname*{argmin}_\beta \mbox{Loss} = \frac{1}{N}\sum_i(y_i - \beta x_i)^2. \]

That is, we’d like to figure out model weights that minimize the loss which is defined by the mean squared errors when the model is a regression model.

The idea of gradient descent is to

  1. Derive the functional form of the gradient of loss w.r.t. to all weights
  2. Initialize all model weights randomly
  3. Calculate the gradient value using the actual data and the current value of weights
  4. Update the weights by (partially) the amount of gradient just calculated
  5. Repeat 3 and 4 until the resulting gradients become small enough

Let’s use the toy example to actually implement a gradent descent optimizer from scratch. First we re-write the loss function explicitly with our setup of one coefficient with a constant (\(\beta = [\beta_0, \beta_1]\)):

\[ \mbox{Loss} = \frac{1}{N}\sum_i\big[y_i-(\beta_0 + \beta_1x_i)\big]^2. \]

Now the gradient (or equivalently the 1st-order derivative) w.r.t. to weights will be:

\[ \begin{aligned} \frac{\partial\mbox{Loss}}{\partial\beta_0} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big], \\ \frac{\partial\mbox{Loss}}{\partial\beta_1} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big]x_i. \end{aligned} \]

The corresponding python function can be coded as:

If we set the above equations to zero we can solve for \(\beta_0\) and \(\beta_1\) analytically and the solution will be exactly just equation \(\eqref{eq:ols}\). But as we just pointed out it suffers from numerical stability issue.

The minimum implementation of our gradient descent optimizer is just a few lines:

As we can see the result is approaching to our analytical solution as the number of steps grows.

On Learning Rate

Learning rate is a hyper-parameter for gradient descent optimizer. The gradient update to our model weights is scaled down by the learning rate to make sure convergence. Too large the learning rate will explode the gradient. Too small the learning rate will slow down the convergence and sometimes result in the optimizer trapped at local sub-optimum.

Let’s re-write our gradient descent optimizer to also track the loss from each training step. And we use the same initialization for a fair comparison.

Now we run the optimization with a variety of different learning rates. For illustration purpose we will only run a few steps.

The result suggests that a learning rate of 1 is too large for our problem. The gradient explodes which make our solution diverge. And a lower learning rate in general converges slower to the optimum. Number of examples used to calculate the gradient also will affect the convergence behavior. In general if the sample size is too small a smaller learning rate should be used to avoid gradient explosion.

This can be more clearly seen if we plot the trace of our training losses:

If the loss doesn’t decrease over training iteration, it is a signal that something is wrong with our model.

Unlike our toy implementation, in modern implementation of any numerical optimizer there will be a lot of techniques to do the best to avoid convergence failure. But it is the model developer’s responsibility to diagnose the training behavior before anything is delivered to the stakeholder. Checking the dynamics of loss is usually the first and quick step to examine whether the training task is functioning as expected.

Stocahstic Gradient Descent

The vanilla gradient descent optimizer we just implemented has one issue. Since for each update it needs to traverse over the entire dataset, it becomes too slow when it comes to large dataset.

Stochastic gradient descent is to overcome this issue. Instead of calculate the gradient using the entire dataset, we can use only one example per update. Each step will be less precise but statistically the final result should be consistent.

Here we introduce the term epoch: One epoch is for the optimizer to traverse the entire dataset once. Number of epochs can be considered as another hyper-parameter of a model.

Here comes the minimum SGD implementation:

SGD won’t be as precise as vanilla GD but for large scale application it can reduce considerable amount of computing time (sometimes from infeasible to feasible). In our simple problem indeed just 1 epoch can have a good approximation already.

The trace of (per-instance) loss for the first 500 updates:

Since the loss is calculated on a per-instance basis, it will fluctuate but with a decreasing trend if nothing went wrong about the optimization process.

In sklearn there are dedicated SGD classes for a variety of learning algorithms. For a linear regression model with SGD solver:

Batch Gradient Descent

To reduce the noise in SGD we can modify it by replacing 1 training example with a batch of examples in a single gradient update. Here’s such implementation of a batch gradient descent optimizer2:

For this simple problem batch size doesn’t have any important impact given enough number of training epochs:

Batch optimizer is currently the best practice of training neural networks in large scale application. The batch size depends on the actual application but usually ranges from 8 (mini) to 1024 (large).

1.2 Logistic Regression

A logistic regression models the outcome probablistically:

\[ \begin{equation} \label{eq:logit} P(Y = 1) = \frac{1}{1 + e^{-X\beta}}, \end{equation} \]

Here the sigmoid function \(s(t) = \frac{1}{1 + e^{-t}}\) is used to transform a real number into probability space \([0, 1]\).

We can interpret the model as a linear model in log-odds. Assuming Y is binary and take a value of 0 or 1, the odds of \(Y = 1\) is defined as \(\frac{P(Y = 1)}{P(Y = 0)} = \frac{P(Y = 1)}{1 - P(Y = 1)}\). We can re-arrange the logistic model equation:

\[ \begin{aligned} \ln \Bigg[ \frac{P(Y = 1)}{1 - P(Y = 1)} \Bigg] &= \ln \Bigg[ \frac{\frac{1}{1 + e^{-X\beta}}}{\frac{e^{-X\beta}}{1 + e^{-X\beta}}} \Bigg] \\ &= \ln(1 + e^{-X\beta}) - \ln e^{-X\beta}(1 + e^{-X\beta}) \\ &= \ln(1 + e^{-X\beta}) - \ln e^{-X\beta} - \ln(1 + e^{-X\beta}) \\ &= - \ln e^{-X\beta} \\ &= X\beta. \end{aligned} \]

That is, the model weights are linear in the log-odds of our target outcome.

When the probability is transformed into odds, the range is transformed from \([0,1]\) to \([0,\infty]\).

If we further transform odds to log-odds, the range is transformed from \([0,\infty]\) to \([-\infty,\infty]\).

Put it together is the effect of the sigmoid function:

1.2.1 Cross Entropy

How do we solve for the model weights \(\beta\) in equation \(\eqref{eq:logit}\)? In the linear regression model we solve for the weights by minimizing the mean squared error. In logistic regression model we need to define measurement for modeling error as well.

Put it differently, we’d like to calculate the distance between our predicted probability and the real event label distribution (called the empirical distribution). In information theory the cross entropy is used to measure the distance between two probability distribution.

Shannon’s Entropy as a Measure of Information

The entropy of a discrete probability distribution is defined as:

\[ \begin{equation} \label{eq:entropy} H(p) = - \sum_i p_i \log_2p_i, \end{equation} \]

where \(p_i\) is the probability for event \(i\). It measures the uncertainty of a stochastic event.

Take a coin flip event as example. We plot the entropy value at different value of coin bias (the probability of having a head instead of a tail.)

It is obvious that the entropy of this event is maximized when the probability of flipping a head is exactly 0.5. At this level the event has a highest level of uncertainty in a sense that it is the most difficult case to predict the outcome of a flip.

What is the intuition behind entropy?

Surprisal in Terms of Rarity

In equation \(\eqref{eq:entropy}\) we first need to interpret the seemingly mysterious term \(-\log_2p_i\). It is the log of the reciprocal of a probability. Generally speaking, the reciproal of a probability \(\frac{1}{p(x)}\) is a 1-in-n scale of probability statement saying that in order for the outcome \(x\) to occur at least once from a stochastic event, it is expected to require having repeated \(n = \frac{1}{p(x)}\) times the event. The rare the outcome, the higher the reciprocal of its probability. When a rare event occurs, it contains much more information than a frequent (or more probable) one. Information in this way can be considered as the level of surprisal.

Information Encoding

But why taking log? Especially why log of base two in Shannon’s entropy? This relates to the use of bits to encode messages/information/random states/facts. A bit (0 or 1) can be used to encode two facts. For example, 0 for a tail and 1 for a head in a coin flip exercise. Apparently if we have \(N\) bits we can encode up to \(2^N\) different outcomes in a stochastic event.

The discussion doesn’t limit to binary. If we have 100 possible outcomes from a random event, with 10 distinct symbols (0 to 9), we only need \(\log_{10}100 = 2\) digits to encode them (decimal 0 to 99).

Now put them together, the rare the outcome, the higher the reciprocal of its probability, and the more bits required to encode this information (so as to distinguish from other possible outcomes).

The formula \(\log_2\frac{1}{P(x)}\) calculates how many bits are necessary to encode a stochastic outcome \(x\) that may occur once out of \(\frac{1}{P(x)}\) times. Let’s call this amount as the information contained by outcome \(x\). Then the entropy in \(\eqref{eq:entropy}\) essentially is calculating the expected number of bits required to encode any outcome possible from the given stochastic event. Or it is the expected information contained by a given stochastic event.

One last thing to note is that the number of bits here is a mathematical artifect that could not always be represented by our discrete real world. Certainly we don’t have non-integer bit in real world computing but the value of entropy is a positive real number not limited to integer.

Distributional Difference

Now move on to cross entropy. Cross entropy between two discrete probability distribution \(p\) and \(q\) over the same support is defined as:

\[ \begin{equation} \label{eq:crossentropy} H(p, q) = - \sum_i p_i \log_2q_i. \end{equation} \]

Intuitively, it means that if we encode a stochastic event with a probability distribution NOT linked to the event, for example a predicted distribution \(q\) based on a model, while the true distribution is \(p\), what will be the expected number of bits required to encode all possibilities from that event.

To understand cross entropy one useful concept is the Kullback-Leibler divergence from \(q\) to \(p\):

\[ \begin{aligned} KL(p \vert\vert q) &= H(p, q) - H(p) \\ &= \sum_ip_i\log_2\frac{p_i}{q_i}. \end{aligned} \]

Mathematically it is just the sum of difference of log-probability from two distribution \(p\) and \(q\), weighted by \(p\). Distribution \(p\) is the reference distribution and \(q\) the approximation distribution. It is a measure of how closely the distribution \(q\) is approximating \(p\). If \(q\) is perfectly mimicking \(p\), the KL divergence is 0 and the cross entropy between \(p\) and \(q\) is the same as the entropy of \(p\): \(H(p, q) = H(p)\).

Based on the above formula we can also interpret KL divergence as the extra bits required due to encoding a stochastic event with a wrong probability distribution.

For our logistic regression model, distribution \(p\) is the empirical distribution (label distribution) and distribution \(q\) is our model predicted distribution. Denote \(q_i = P(y_i = 1)\) for the prediction of \(i\)-th example. The cross-entropy-loss of our model hence can be written as:

\[ \mbox{Cross-Entropy Loss} = - \frac{1}{N}\sum_i^N \bigg[ y_i\log_2q_i + (1 - y_i)\log_2(1 - q_i)\bigg], \]

where \(y_i \in \{0,1\}\) is the \(i\)-th binary training label and \(P(y_i = 1)\) the model prediction for the \(i\)-th example out of \(N\) total training examples. This is the mean value of cross entropy for each training example. It measures how well our model is predicting the label based on the distributional difference between the labels and the model outputs.

Since \(q_i = P(y_i = 1)\) is expressed by our model equation \(\eqref{eq:logit}\), now we can apply gradient descent to the loss function to find out the optimum model weights that minimize the cross-entropy loss.

1.2.2 Maximum Likelihood Estimator

Before we implement our optimizer for a logistic regression model, we demonstrate that minimizing cross entropy is indeed equivalent to maximizing data likelihood.

The data likelihood is just the product of all predicted probabilities for individual example, provided that they are independent.

\[ \mbox{likelihood} = \prod_i^N q_i^{y_i}(1 - q_i)^{1 - y_i}. \]

The maximum likelihood estimator will try to maximize the log of the likelihood, which is:

\[ \begin{aligned} \mbox{log-lik} &= \log_2 \prod_i^N q_i^{y_i}(1 - q_i)^{1 - y_i} \\ &= \sum_i^N \log_2 q_i^{y_i}(1 - q_i)^{1 - y_i} \\ &= \sum_i^N \bigg[ y_i\log_2 q_i + (1 - y_i)\log_2(1 - q_i) \bigg]. \end{aligned} \]

By taking the average as well, the negative log-likelihood is exactly the cross entropy.

Though we didn’t discuss this linkage in linear regression, if we assume the error term in the model is independently distributed Normally, the OLS solution to the model weights (equation \(\eqref{eq:ols}\)) is indeed also the MLE solution.

1.2.3 Gradient Descent with Log Loss

Now let’s also implement a batch gradient descent optimizer for a logistic regression model. We will use the same toy example and create additional random binary labels for this exercise.

The gradient function must be derived with respect to model weights. To simplify the math we replace log of base 2 with natural log (with no impact on the optimization), and we take advantage of the fact that the derivative of the sigmoid function is:3

\[ \begin{aligned} \frac{ds(t)}{dt} &= \frac{d\frac{1}{1 + e^{-t}}}{dt} \\ &= -(1 + e^{-t})^{-2} \cdot (- e^{-t}) \\ &= \frac{e^{-t}}{(1 + e^{-t})^2} \\ &= \frac{1}{1 + e^{-t}} \cdot \frac{e^{-t}}{1 + e^{-t}} \\ &= s(t) \cdot [1 - s(t)]. \end{aligned} \]

The gradient in our univariate model w.r.t. the bias term will be:4

\[ \begin{aligned} \frac{\partial\mbox{LogLoss}}{\partial\beta_0} &= - \frac{1}{N}\sum_i \bigg[ y_i\frac{\partial\ln q_i}{\partial\beta_0} + (1 - y_i)\frac{\partial\ln(1 - q_i)}{\partial\beta_0}\bigg] \\ &= - \frac{1}{N}\sum_i \bigg[ y_i\frac{1}{q_i}\frac{\partial q_i}{\partial\beta_0} + (1 - y_i)\frac{1}{1 - q_i}\frac{\partial(1 - q_i)}{\partial\beta_0}\bigg] \\ &= - \frac{1}{N}\sum_i \bigg[ y_i\frac{1}{q_i}\frac{\partial (\beta_0 + \beta_1x_i)}{\partial\beta_0}\frac{\partial q_i(t)}{\partial t} - (1 - y_i)\frac{1}{1 - q_i}\frac{\partial (\beta_0 + \beta_1x_i)}{\partial\beta_0}\frac{\partial q_i(t)}{\partial t}\bigg] \\ &= - \frac{1}{N}\sum_i \bigg[ y_i\frac{1}{q_i}q_i(1 - q_i) - (1 - y_i)\frac{1}{1 - q_i}q_i(1 - q_i)\bigg] \\ &= - \frac{1}{N}\sum_i \bigg[ y_i(1 - q_i) - (1 - y_i)q_i \bigg] \\ &= - \frac{1}{N}\sum_i (y_i - q_i). \end{aligned} \]

Similary for the weight:

\[ \frac{\partial\mbox{LogLoss}}{\partial\beta_1} = - \frac{1}{N}\sum_i (y_i - q_i)x_i. \]

Now the Python code for batch gradient descent with log-loss:

Comparing to linear regression, a logistic regression model is harder to converge. Since our naive implementation does not do convergence diagnostics, let’s use R’s built-in glm function which use Newton’s method (a 2nd-order optimizer utilizing not only 1st-order but also 2nd-order derivatives) to check the estimation result of our toy example:

Now increase both the learning rate and training epochs of our naive gradient descent optimizer:

Seems better.

Or we can use the Python package statsmodels (which also uses a 2nd-order optimizer by default) to check our result:

Or the sklearn result:

2 Automatic Differentiation

In the previous section we implement a simple gradient descent optimizer by manually derive the functional form of gradient on our own. This could be troublesome if our model becomes more and more complicated, as in the case of a deep neural net.

Automatci differentiation is a programming technique to calculate the gradient of any given function. One of the most popular library for this purpose is TensorFlow.

Let’s use tensorflow to implement our simple gradient descent optimizer again. But this time we will NOT explicitly derive the gradient function. Instead, we will only specify the target function which is just the loss function of our model.

import tensorflow as tf
tf.enable_eager_execution()

# Use tensor to represent our data.
# Note that we need to be very specific about dtype/shape of our tensors.
X_tf = tf.convert_to_tensor(X, dtype=tf.float32)
beta_tf = tf.reshape(tf.convert_to_tensor(beta, dtype=tf.float32), (2,1))
e_tf = tf.reshape(tf.convert_to_tensor(e, dtype=tf.float32), (N, 1))
y_tf = tf.matmul(X_tf, beta_tf) + e_tf
y2_tf = tf.reshape(tf.convert_to_tensor(y2, dtype=tf.float32), (N, 1))

def loss_mse_tf(X, y, beta):
  y_hat = tf.matmul(X, beta)
  return tf.reduce_mean(input_tensor = (y_hat - y)**2)

def logloss_tf_bad(X, y, beta):
  # This can suffer from numerical stability issue.
  logloss_pos = y * tf.log(tf.sigmoid(tf.matmul(X, beta)))
  logloss_neg = (1 - y) * tf.log(1 - tf.sigmoid(tf.matmul(X, beta)))
  return - tf.reduce_mean(logloss_pos + logloss_neg)

def logloss_tf(X, y, beta):
  # tf.sigmoid is not numerically stable.
  # But there is a convenient function to do the cross entropy calculation stably.
  s = tf.nn.sigmoid_cross_entropy_with_logits(labels=y, logits=tf.matmul(X, beta))
  return tf.reduce_mean(s)

def gd_optimize_tf(X, y, loss_func, lr=.01, n_step=100):
  grad_func_tf = tf.contrib.eager.gradients_function(loss_func, params=[2])
  beta = tf.random_normal((2, 1))
  for step in range(n_step):
    grad = grad_func_tf(X, y, beta)[0]
    beta -= lr * grad
  return beta.numpy()

# For the MSE loss problem.
print(gd_optimize_tf(X_tf, y_tf, loss_func=loss_mse_tf, n_step=3000))

# For the cross entropy loss problem.
print(gd_optimize_tf(X_tf, y2_tf, loss_func=logloss_tf, lr=.5, n_step=5000))

In the above coding example one should realize that we no longer need to hardcode the functional form of the gradients. Instead we just plug-in the loss function and let tensorflow to do the gradient calculation for us.

Of course in actual development we will use higher-level APIs to implement our model, where the entire optimization process is abstracted away from the application code.

3 Neural Networks

Both linear regression and logistic regression can be considered as simple additive model of the form:

\[ \hat{y} = \Phi\bigg(\sum_{i=1}^Pw_ix_i\bigg), \]

where \(P\) is the number of features used, \(x_i\) is the \(i\)-th feature, and \(\Phi(\cdot)\) is a function applied to the output. In linear regression \(\Phi(\cdot)\) is simply an identity function. In logistic regression \(\Phi(\cdot)\) is the standard sigmoid function.

Now consider there is a way to ensemble multiple such additive models together to generate a potentially better and more sophisticated model. We use the following diagram for illustration.

In the above diagram, \(Y_{11}\) is a single additive model

\[ Y_{11} = \Phi(W_{111}X_1 + W_{211}X_2 + W_{311}X_3). \]

Similarly \(Y_{12}\) is another such model (with the same input feature set but different model weights)

\[ Y_{12} = \Phi(W_{112}X_1 + W_{212}X_2 + W_{312}X_3). \]

Model \(Y_2\) is yet another additive model but takes the output of the above two models:

\[ Y_2 = \Phi(W_{1121}Y_{11} + W_{1221}Y_{12}). \]

The above setup is a simple architecture of a neural network model, with only one hidden layer of two neurons. (We also ignore the constant/bias term in each layer for simplicity.) A neuron is simply an additive model with a so-called activation function \(\Phi(\cdot)\) to transform the output from any real number into a scaled signal.

One now can easily realize that a logistic regression model could be viewed as a degenerated neural network model with single neuron and using sigmoid as the activation function. And a linear regression model is a degenerated neural network model with single neuron and without an activation function.

3.1 Activation Function

Why do we need the activation function? In the above neural network model in the absence of activation function the final output model \(Y_2\) will degenerate into a simple linear model. We can use simpler notations to demonstrate this:

\[ \begin{aligned} y_1 &= ax + b, \\ y_2 &= cx + d, \\ y_3 &= e + fy_1 + gy_2 \\ &= e + f(ax + b) + g(cx + d) \\ &= \underbrace{(e + fb + gd)}_\text{Bias} + \underbrace{(fa + gc)}_\text{Weight}x. \end{aligned} \]

Without activation function, no matter how many neurons or layers we design for our model, it eventually reduces to a simple linear model. With the activation function applied to each neuron, the model becomes non-linear and hence can handle much more complicated patterns hidden behind the data.

Some popular activation functions:

3.2 Backpropagation

To solve for model weights in a neural network, we use a technique called backpropagation which is essentially an iterative process of gradient descent.

To simplify notation we assume each neuron is simply a univariate model. Consider the following minimum architecture:

Mathematically:

\[ \begin{aligned} \hat{y} &= \Phi(b_1 + w_1z) \\ &= \Phi(b_1 + w_1\Phi(b_0 + w_0x)), \end{aligned} \]

where

\[ z = \Phi(b_0 + w_0x), \]

and

\[ \Phi(t) = \frac{1}{1 + e^{-t}}. \]

3.2.1 MSE Loss

Though it may not be very meaningful to use MSE loss when the output layer is applied with an activation function, we can still do it for educational purpose.

\[ \mbox{MSE-Loss} = \frac{1}{N}\sum_i^N (y_i - \hat{y}_i)^2. \]

Firstly we take the derivative w.r.t. the weight in the last layer:

\[ \begin{aligned} \frac{\partial \mbox{MSE-Loss}}{\partial w_1} &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i)\frac{\partial \hat{y}_i}{\partial w_1} \\ &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \underbrace{ \frac{\partial t}{\partial w_1}\frac{\partial \Phi(t)}{\partial t} }_{t = b_1 + w_1\Phi(b_0 + w_0x)}\\ &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \Phi(t)(1 - \Phi(t)) \cdot z_i. \end{aligned} \]

Similarly for the bias in the last layer:

\[ \frac{\partial \mbox{MSE-Loss}}{\partial b_1} = - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \Phi(t)(1 - \Phi(t)). \]

Now move on to the bias and weight in the first layer:

\[ \begin{aligned} \frac{\partial \mbox{MSE-Loss}}{\partial w_0} &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i)\frac{\partial \hat{y}_i}{\partial w_0} \\ &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \underbrace{ \frac{\partial t}{\partial w_0}\frac{\partial \Phi(t)}{\partial t} }_{t = b_1 + w_1\Phi(b_0 + w_0x)}\\ &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \Phi(t)(1 - \Phi(t)) \cdot \underbrace{ \Phi(k)(1 - \Phi(k)) }_{k = b_0 +w_0x} \cdot w_1 \cdot x_i, \\ \frac{\partial \mbox{MSE-Loss}}{\partial b_0} &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \Phi(t)(1 - \Phi(t)) \cdot \Phi(k)(1 - \Phi(k)). \end{aligned} \]

One can clearly see there is a linkage between the derivative of the weights in consecutive layers:

\[ \begin{aligned} \frac{\partial \mbox{MSE-Loss}}{\partial w_1} &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \Phi(t)(1 - \Phi(t)) \cdot z_i, \\ \frac{\partial \mbox{MSE-Loss}}{\partial w_0} &= - \frac{1}{N}\sum_i (y_i - \hat{y}_i) \cdot \underbrace{\Phi(t)(1 - \Phi(t))}_{\hat{y}_i(1 - \hat{y}_i)} \cdot \underbrace{\Phi(k)(1 - \Phi(k)) \cdot w_1 \cdot x_i}_{\frac{\partial w_1z}{\partial w_0} = \frac{\partial w_1\Phi(b0 + w_0x)}{\partial w_0}}. \end{aligned} \]

3.2.2 Cross-Entropy Loss

Similarly we can derive the gradients for cross-entropy loss.

\[ \begin{aligned} \mbox{LogLoss} &= - \frac{1}{N}\sum_i^N \bigg[ y_i\ln\hat{y}_i + (1 - y_i)\ln(1 - \hat{y}_i)\bigg], \\ \frac{\partial \mbox{LogLoss}}{\partial w_1} &= - \frac{1}{N} \sum_i (y_i - \hat{y}_i)z_i, \\ \frac{\partial \mbox{LogLoss}}{\partial w_0} &= - \frac{1}{N} \sum_i (y_i - \hat{y}_i)\Phi(k)(1 - \Phi(k))w_1x_i.\\ \end{aligned} \]

(Skip the bias terms to save space.)

Now let’s implement the simple neural network model in Python:

Here we will use the hello-world example of artificial neural network: The XOR problem. The XOR logical outcome, besides extremely simple, is not linearly separable. So it serves as a good example of showcasing neural networks’ non-linearity.

The input data is simply combination of two binary switches. (For completeness we also include a constant term which always evaluate to 1 as the first feature.) The output data is the XOR result.

Now let’s see if our simple neural network model can learn the XOR pattern.

For this simple example, both MSE and cross-entropy loss can work fine to figure out the XOR pattern. (Strictly speaking cross-entropy loss performs better.)

4 Regularization

Regularization is a technique to mitigate overfitting. It is not particular to neural networks but general to all machine learning models.

A regularization is a constraint added onto the original optimization problem (loss minimization). Consider model weights as a real vector, we usually use the norm of the vector to constraint its size in the optimization. The norm is a measure of size of a vector. The general idea is to add a penalty to the target function (which is a loss function) such that it discourages using large weights (which increase the size of vector) to achieve the minimization goal.

In general, a MSE loss minimization with a p-norm regularization for a linear model can be written (in matrix form) as:

\[ \begin{aligned} \hat{y} &= X\mathrm{B}, \\ \operatorname*{argmin}_\beta \mbox{Loss} &= \frac{1}{N}\bigg[ \underbrace{(y - X\mathrm{B})^T(y - X\mathrm{B})}_\text{sum of squared errors} + \underbrace{\lambda\Vert\mathrm{B}\Vert_{p}}_\text{p-norm regularization} \bigg], \end{aligned} \]

with a model weight vector \(\mathrm{B} = [\beta_1, \beta2, ..., \beta_k]\). The parameter \(\lambda\) is a new hyper-parameter introduced by the regularization.

Or put it in a scalar form:

\[ \begin{equation} \label{eq:loss_min_reg} \operatorname*{argmin}_\beta \mbox{Loss} = \frac{1}{N}\sum_{i=1}^N\bigg( y_i - \mathrm{B}x_i\bigg)^2 + \frac{\lambda}{N}\bigg(\sum_{j=1}^k\vert\beta_j\vert^p\bigg)^{1/p}. \end{equation} \]

Popular choices of \(p\) is \(p = 1\) (L1-Norm) and \(p = 2\) (L2-Norm). Notably, \(p\) can be any non-integer real value and would have even better result than integer-norm. But their computational difficulty make them much less desirable in practice.

In practice, we also ignore the root in the norm for computational simplicity. So the problem indeed becomes

\[ \operatorname*{argmin}_\beta \mbox{Loss} = \frac{1}{N}\sum_{i=1}^N\bigg( y_i - \mathrm{B}x_i\bigg)^2 + \frac{\lambda}{N}\bigg(\sum_{j=1}^k\vert\beta_j\vert^p\bigg). \]

There is also a so-called elasticnet regularization which combines both L1 and L2 norms together to give potentially better result. However it requires a lot more computing resources and hence become much less feasible in a neural network model.

4.1 L2-Norm Regularization

The L2-Norm shrinks the size of model weights. Those who contribute less to loss minimization will shrink more.

Back to our univariate linear model \(\hat{y}_i = \beta_0 + \beta_1x_i\) for symolic simplicity. Our MSE loss is

\[ \mbox{MSE-Loss} = \frac{1}{N}\sum_i\big[y_i-(\beta_0 + \beta_1x_i)\big]^2 + \frac{\lambda}{N}(\beta_0^2 + \beta_1^2). \]

Since the penaty is additive, our gradient solution is extremely easy:

\[ \begin{aligned} \frac{\partial\mbox{MSE-Loss}}{\partial\beta_0} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big] + \frac{2}{N}\lambda\beta_0, \\ \frac{\partial\mbox{MSE-Loss}}{\partial\beta_1} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big]x_i + \frac{2}{N}\lambda\beta_1. \end{aligned} \]

A linear regression model with l2 regularization is referred to as the ridge regression. Be aware that in implementing the batch optimizer we need to scale down the update from l2 norm by the size of batch in order to balance the size of l2 norm and the original loss.

The resulting estimates are smaller than the vanilla gradient descent.

One thing worth noting is that when batch gradient descent is used along with regularization, a side effect exists due to the scaling of the batch size on the regularization term.

Experiments with different batch sizes with l2 regularization:

Let’s check the result using sklearn’s Ridge regressor (which doesn’t use gradient descent as its solver):

The result is closed to gradient descent with nearly a full-batch update (i.e., use the entire training data for one update).

Exactly the same logic can apply to logistic regression and is not discussed here to avoid redundancy.

4.2 L1-Norm Regularization

The L1-Norm prefers sparsity in the model weights. That is, it may zero out weights that are not contributing to the loss. While the L2-Norm only makes them arbitrarily small.

MSE loss with l1 norm:

\[ \mbox{MSE-Loss} = \frac{1}{N}\sum_i\big[y_i-(\beta_0 + \beta_1x_i)\big]^2 + \lambda(\vert\beta_0\vert + \vert\beta_1\vert), \]

with gradients:5

\[ \begin{aligned} \frac{\partial\mbox{MSE-Loss}}{\partial\beta_0} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big] + \lambda\frac{\beta_0}{\vert\beta_0\vert}, \\ \frac{\partial\mbox{MSE-Loss}}{\partial\beta_1} &= - \frac{2}{N}\sum_i \big[ y_i - (\beta_0 + \beta_1x_i) \big]x_i + \lambda\frac{\beta_1}{\vert\beta_1\vert}. \end{aligned} \]

A linear regression model with l1 regularization is referred to as the lasso regression. Let’s first check the result using sklearn’s Lasso regressor (which uses a coordinate descent solver):

To derive roughly the same result, we need to calibrate the coefficient on regularization in our gradient descent solver:

We can also check the consistency by calling sklearn’s SGDRegressor:

Now let’s purposely add one random feature as a noise into the design matrix and see how the regularization helps to shrink the weight of the noise.

As one can see, Lasso regressor is able to completely wipe out the weight on the redundant noise, while Ridge can only shrink it toward zero.

To arrive roughly at the same result of Ridge using our simple gradient descent solver:

And for the Lasso case:

One thing to note: It is in general difficult to arrive at sparse solution (0 weight) for a naive gradient descent implementation such as ours. Some further mathematical tricks like the proximal gradient metohd must be applied in order to produce sparse result under finite iterations.

Finally, again, exactly the same logic can apply to logistic regression and is not discussed further to avoid redundancy.

4.3 Geometric Interpretation of L1/L2 Regularization

Consider a two-parameter modeling case, where we plot the two possible weights \(w_1\) and \(w_2\) as a Euclidean coordinate system. The MSE loss minimization problem stated in equation \(\eqref{eq:ols}\) can be rewritten as an optimization with linear constraint:

\[ \begin{aligned} & \operatorname*{argmin}_\beta & & \frac{1}{N}\sum_{i=1}^N\bigg( y_i - \mathrm{B}x_i\bigg)^2 \\ & \text{subject to} & & \bigg(\sum_{j=1}^k\vert\beta_j\vert^p\bigg)^{1/p} \le t. \end{aligned} \]

Solving the above problem (using for example the method of Lagrange multipliers) will result in exactly the same target function as in equation \(\eqref{eq:ols}\).

Now if we plot the linear constraint on the Euclidean space (for the case of \(k = 2\) and an arbitrary value of constant \(t\)), the possible parameter combination will fall into a cirle for \(p = 2\) (L2 regularization) or a squared diamond for \(p = 1\) (L1 regularization), both centered at the origin.

Simply plot the constraint area is not that informative. We need to also visualize the possible values of loss function.

Let’s use the toy model in our previous linear regression section to do the visualization. We will iterate over the coordinate space within \(0 <= w1 <= 10\) and \(0 <= w2 <= 10\) to collect all possible resulting loss values. The loss will be a 3rd axis added onto the existing plain.

Note that we also plot the contour on the original 2-d plain. The contour depicts all the weight combinations that lead to the same amount of loss. And we mark the minimum with a cross to clearly point out the optimum loss which can be achieved by the unregularized OLS estimator in equation \(\eqref{eq:ols}\).

Now if we combine the two plots together, especially the contour on the parameter plain, the tangent point between the regularization area and the contour is exactly our regularized solution for the weights.6

The constraint constant control the size of regularization, for a larger constant (looser constraint) our tagent point will move closer to the unregularized optimum. For this geometric point of view, one should also realize that since the L1 regularization area is a sharp diamond square, it is more likely to tangent the contour on the edge which exactly represent a sparse solution to the weight (on each edge point there is one weight zeroed out).

4.4 Probabilistic Interpretation of L1/L2 Regularization

If we took a Bayesian approach on the weight estimation, the task is to solve for the posterior distribution of weight:

\[ P(W|y) = \frac{P(y|W) \cdot P(W)}{P(y)} \propto P(y|W) \cdot P(W). \]

then a Normal prior on the weight \(W \sim \mbox{Normal}\) will result in a maximum a posteriori estimator to have a target function with the L2 regularization term, and a Laplacean prior \(W \sim \mbox{Laplace}\) will result in the L1 term.

This is quite straightforward if we take a look at the probability density function of these two distributions:

\[ \begin{aligned} \mbox{Normal}(\mu, \sigma)_\text{pdf} &= f(w) = \frac{1}{\sqrt{2\pi\sigma^2}}e^{-\frac{(w - \mu)^2}{2\sigma^2}}, \\ \mbox{Laplace}(\mu, b)_\text{pdf} &= g(w) = \frac{1}{2b}e^{-\frac{\vert w - \mu\vert}{b}}. \end{aligned} \]

Now if we want to maximize the log of \(P(W|y)\) (maximum a posteriori), the gradient to the log of a Normal prior will give us:

\[ \begin{aligned} \frac{\partial \ln f(w)}{\partial w} &= \frac{\partial \bigg[-\frac{1}{2}\ln(2\pi\sigma^2) - \frac{(w - \mu)^2}{2\sigma^2}\bigg]}{\partial w} \\ &= - \frac{1}{\sigma^2}(w - \mu), \end{aligned} \]

and for a Laplacean prior:

\[ \begin{aligned} \frac{\partial \ln g(w)}{\partial w} &= \frac{\partial \bigg[-\frac{1}{2b} - \frac{\vert w - \mu \vert}{b}\bigg]}{\partial w} \\ &= - \frac{1}{b}\frac{w}{\vert w \vert}. \end{aligned} \]

The regularization coefficient we previously discussed (hyper-parameter \(\lambda\)) can be mapped to the constant on the (reciprocal of) scale parameter of the Bayesian prior. A larger \(\lambda\) corresponds to a smaller variance on the prior, hence the size of weight is being constrained more in the posterior estimation, resulting in smaller weight.

We can plot the standardized Normal and Laplace distribution to clearly see their difference:

Compared to a Normal prior, a Laplacean put much more density at the center. When both distribution is standardized (with location at 0 and scale at 1) as just plotted above, this can be interpreted as that a Laplacean prior has a stronger preference for a sparse solution (weight = 0).

4.5 Dropout

Another maybe easier way of regularization is the dropout mechanism. It is first introduced in a neural network model but can apply to some other machine learning algorithms as well (such as gradient boosting trees).

  1. One can try change the sample size arbitrarily to see the behavior of the estimator in our toy example.↩

  2. Sometimes “mini-batch gradient descent” is used to describe SGD with batch size > 1. Here we ignore the redundant wording and just call it batch gradient descent.↩

  3. Here we use the common derivatives: \(\frac{df(x)^n}{dx} = nf(x)^{n-1}f'(x)\) and \(\frac{de^{f(x)}}{dx} = f'(x)e^{f(x)}.\)↩

  4. Here we use the common derivative \(\frac{d\ln f(x)}{dx} = \frac{f'(x)}{f(x)}\) and the chain rule to handle the term \(\frac{\partial\ln q_i}{\partial\beta_0}\) where \(q_i\) is the sigmoid computed for the \(i\)-th example.↩

  5. Note that the derivative \(\frac{du}{dx} = \frac{u}{\vert u \vert}\frac{du}{dx}\) at \(u = 0\) is undefined.↩

  6. Since plotly.js currently doesn’t support uneven interval for contour plot, in the contour-regularization plot we take natrual log of MSE just to scale the value so that the contour line will have non-linear interval. This help us show more lines when loss becomes smaller.↩

LS0tCnRpdGxlOiAiTmV1cmFsIE5ldHdvcmtzIEZ1bmRhbWVudGFscyIKc3VidGl0bGU6ICJ3aXRoIEV4YW1wbGVzIHVzaW5nIFB5dGhvbiIKYXV0aG9yOgotIG5hbWU6IEt5bGUgQ2h1bmcKICBhZmZpbGlhdGlvbjoKZGF0ZTogImByIGZvcm1hdChTeXMudGltZSgpLCAnJWQgJUIgJVknKWAiCm91dHB1dDoKICBodG1sX25vdGVib29rOiAKICAgIG51bWJlcl9zZWN0aW9uczogeWVzCiAgICB0aGVtZTogZmxhdGx5CiAgICB0b2M6IHllcwogICAgaGlnaGxpZ2h0OiBweWdtZW50cwotLS0KPCEtLSBFbWJlZCBwbG90bHkgamF2YXNjcmlwdCBsaWJyYXJ5LgogIFRoZSBwcmV2aWV3IG9mIHBsb3RseSBvdXRwdXQgaW4gUlN0dWRpbyB3b24ndCB3b3JrCiAgc2luY2Ugd2UgZG9uJ3QgaW5jbHVkZSB0aGUgcGxvdGx5LmpzIGluIGVhY2ggaW5kaXZpZHVhbCBwbG90ICh0byByZWR1Y2UgZmlsZSBzaXplKS4KLS0+CjxzY3JpcHQgc3JjPSJqcy9wbG90bHktbGF0ZXN0Lm1pbi5qcyI+PC9zY3JpcHQ+Cgo8IS0tIExpbmsgdG8gbWF0aGpheCBqYXZhc2NyaXB0IGxpYnJhcnkuCiAgVGhpcyBpcyBmb3IgbGF0ZXggbm90YXRpb24gaW4gcGxvdGx5IG91dHB1dC4KLS0+CjxzY3JpcHQgdHlwZT0idGV4dC9qYXZhc2NyaXB0IiBhc3luYwogIHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvbWF0aGpheC8yLjcuNS9NYXRoSmF4LmpzP2NvbmZpZz1UZVgtTU1MLUFNX0NIVE1MIj4KPC9zY3JpcHQ+Cgo8IS0tRm9yIGVxdWF0aW9uIHJlZmVyZW5jZSBpbiBSbWQuLS0+CjxzY3JpcHQgdHlwZT0idGV4dC94LW1hdGhqYXgtY29uZmlnIj4KTWF0aEpheC5IdWIuQ29uZmlnKHsKICBUZVg6IHsgZXF1YXRpb25OdW1iZXJzOiB7IGF1dG9OdW1iZXI6ICJBTVMiIH0gfQp9KTsKPC9zY3JpcHQ+CgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0KbGlicmFyeShyZXRpY3VsYXRlKQpyIDwtIHRyeSh1c2VfcHl0aG9uKFN5cy5nZXRlbnYoIlBZVEhPTl9QQVRIIiksIHJlcXVpcmVkPVRSVUUpLCBzaWxlbnQ9VFJVRSkKaWYgKCBpcyhyLCAidHJ5LWVycm9yIikgKSB7CiAgciA8LSB0cnkodXNlX3ZpcnR1YWxlbnYoU3lzLmdldGVudigiUFlUSE9OX1BBVEgiKSwgcmVxdWlyZWQ9VFJVRSksIHNpbGVudD1UUlVFKQogIGlmICggaXMociwgInRyeS1lcnJvciIpICkgdXNlX2NvbmRhZW52KFN5cy5nZXRlbnYoIlBZVEhPTl9QQVRIIiksIHJlcXVpcmVkPVRSVUUpCn0KYGBgCgojIFByZXJlcXVpc2l0ZXMKCkJlZm9yZSB3ZSBldmVuIHN0YXJ0LAppdCBpcyBvZiBjcnVjaWFsIGltcG9ydGFuY2UgdG8gZmlyc3QgdW5kZXJzdGFuZCBkZWVwbHkgbGluZWFyIGFuZCBsb2dpc3RpYyByZWdyZXNzaW9uLgpUaGlzIGlzIGJlY2F1c2UgKGFzIHdlIHdpbGwgc2VlIGluIGxhdGVyIGRpc2N1c3Npb24pIHRoZXkgYXJlIHRoZSB2ZXJ5IGJhc2ljIGNvbXBvbmVudHMgaW4gYSBnZW5lcmFsIG5ldXJhbCBuZXR3b3JrIG1vZGVsLgoKIyMgTGluZWFyIFJlZ3Jlc3Npb24KCkEgbGluZWFyIG1vZGVsIGNhbiBiZSB3cml0dGVuIGluIGEgbWF0cml4IGZvcm0KCiQkClkgPSBYXGJldGEgKyBcZXBzaWxvbiwKJCQKCndoZXJlICRZJCBpcyB0aGUgb3V0cHV0IG9yIGxhYmVsIHZlY3RvciBvZiBsZW5ndGggJE4kIChudW1iZXIgb2Ygb2JzZXJ2YXRpb25zKSwKJFgkIGlzIHRoZSBpbnB1dCBmZWF0dXJlIG1hdHJpeCAocmVmZXJyZWQgdG8gYXMgdGhlICpkZXNpZ24gbWF0cml4KiBpbiBzdGF0aXN0aWNzKSB3aXRoIGRpbWVuc2lvbiAkTiQgYnkgJFAkIChudW1iZXIgb2YgZmVhdHVyZXMpLAokXGJldGEkIGlzIHRoZSBtb2RlbCB3ZWlnaHRzL2NvZWZmaWNpZW50cyAoYSBjb2x1bW4gdmVjdG9yIG9mIGxlbmd0aCAkUCQpIGZvciB3aGljaCB3ZSdkIGxpa2UgdG8gc29sdmUsCiRcZXBzaWxvbiQgaXMgdGhlIG1vZGVsIHJlc2lkdWFsIG9yIGVycm9yIHZlY3Rvci4KCiMjIyBPcmRpbmFyeSBMZWFzdCBTcXVhcmVzCgpUaGUgY2xhc3NpY2FsIHdheSB0byBzb2x2ZSBmb3IgJFxiZXRhJCBpcyBbb3JkaW5hcnkgbGVhc3Qgc3F1YXJlc10oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvT3JkaW5hcnlfbGVhc3Rfc3F1YXJlcykuClRoZSBpZGVhIG9mIE9MUyBpcyBmaW5kIG91dCB0aGUgd2VpZ2h0cyB0aGF0IG1pbmltaXplIHRoZSBtZWFuIG9mIHNxdWFyZWQgbW9kZWwgZXJyb3JzOgoKJCQKXGJlZ2lue2FsaWduZWR9ClxtYm94e21zZSAobG9zcyl9CiY9IFxmcmFjezF9e059XHN1bV9pXGVwc2lsb25eMl9pIFxcCiY9IFxmcmFjezF9e059XHN1bV9pKHlfaSAtIFxiZXRhIHhfaSleMiwKXGVuZHthbGlnbmVkfQokJAoKd2hlcmUgJHlfaSQgYW5kICR4X2kkIGlzIHRoZSAkaSQtdGggb2JzZXJ2YXRpb24uClRoZSBmaXJzdC1vcmRlciBjb25kaXRpb24gKHJlcXVpcmluZyB0aGF0IHRoZSBmaXJzdC1vcmRlciBkZXJpdmF0aXZlIHcuci50LiB3ZWlnaHRzIGFyZSBhbGwgemVybykgZ2l2ZXMgdXMgdGhlIE9MUyBzb2x1dGlvbiBmb3IgbW9kZWwgd2VpZ2h0cyAkXGJldGEkIGFuYWx5dGljYWxseSAoaW4gbWF0cml4IG5vdGF0aW9uKToKCiQkClxiZWdpbntlcXVhdGlvbn0gXGxhYmVse2VxOm9sc30KXGhhdHtcYmV0YX0gPSAoWCdYKV57LTF9WCdZLgpcZW5ke2VxdWF0aW9ufQokJAoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX29sc30KaW1wb3J0IG51bXB5IGFzIG5wCmZyb20gbnVtcHkubGluYWxnIGltcG9ydCBpbnYKCmRlZiBvbHMoWCwgeSk6CiAgICByZXR1cm4gaW52KFguVC5kb3QoWCkpLmRvdChYLlQpLmRvdCh5KQpgYGAKCkxldCdzIGNvbnNpZGVyIGEgdG95IG1vZGVsIHdpdGggb25seSBvbmUgbm9uLWNvbnN0YW50IGZlYXR1cmU6CgokJAp5X2kgPSA2ICsgNHhfaSArIFxlcHNpbG9uX2kuCiQkCgpJbiB0aGlzIG1vZGVsIHRoZSBvdXRjb21lICR5JCBpcyBkZXRlcm1pbmVkIGJ5IGEgYmlhcyB0ZXJtIHBsdXMgYSBzaW5nbGUgdmFyaWFibGUgJHgkLAp3aXRoIGFuICppbmRlcGVuZGVudGx5IGRpc3RyaWJ1dGVkKiBub2lzZSB0ZXJtICRcZXBzaWxvbiBcc2ltIFxtYm94e05vcm1hbH0oMCwgMSkkLgoKQ3JlYXRlIHNvbWUgcmFuZG9tIGRhdGEgZ2VuZXJhdGVkIGZyb20gdGhpcyBtb2RlbDoKCmBgYHtweXRob24gbGluZWFyX3JlZ190b3lfZXhhbXBsZX0KIyBDcmVhdGUgdG95IGV4YW1wbGUuCm5wLnJhbmRvbS5zZWVkKDc3NykKCk4gPSAxMDAwClggPSBucC5zdGFjayhbbnAub25lcyhOKSwgbnAucmFuZG9tLm5vcm1hbChzaXplPU4pXSwgYXhpcz0xKQpiZXRhID0gbnAuYXJyYXkoWzYsIDRdLCBkdHlwZT1ucC5mbG9hdDMyKSAgIyBUcnVlIG1vZGVsIHdlaWdodHMuCmUgPSBucC5yYW5kb20ubm9ybWFsKHNpemU9TikKeSA9IFguZG90KGJldGEpICsgZQoKcHJpbnQoWFs6MTBdKQpgYGAKCmBgYHtweXRob24gbGluZWFyX3JlZ19wbG90fQpmcm9tIHBsb3RseS5vZmZsaW5lIGltcG9ydCBwbG90CmltcG9ydCBwbG90bHkuZ3JhcGhfb2JqcyBhcyBnbwoKZGVmIHBsb3Rfb2ZmbGluZShkYXRhLCBsYXlvdXQsIG9maWxlKToKICBwID0gcGxvdCh7ImRhdGEiOiBkYXRhLCAibGF5b3V0IjogbGF5b3V0fSwKICAgICAgICAgICBmaWxlbmFtZT1vZmlsZSwgYXV0b19vcGVuPUZhbHNlLAogICAgICAgICAgIGluY2x1ZGVfcGxvdGx5anM9RmFsc2UpCiAgcmV0dXJuIHAKCm9maWxlID0gInBsb3RzL3RveV9yZWcuaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVtnby5TY2F0dGVyKHg9WFs6LDFdLCB5PXksIG1vZGU9Im1hcmtlcnMiKV0sCiAgbGF5b3V0PWdvLkxheW91dCh0aXRsZT0iRGF0YSBHZW5lcmF0ZWQgZnJvbSBUb3kgTW9kZWwiLAogICAgICAgICAgICAgICAgICAgeGF4aXM9ZGljdCh0aXRsZT0ieCIpLAogICAgICAgICAgICAgICAgICAgeWF4aXM9ZGljdCh0aXRsZT0ieSIpKSkKYGBgCgpgYGB7ciwgZWNobz1GQUxTRX0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpXaXRob3V0IGNvbnNpZGVyYXRpb24gb2YgdGhlIG5vaXNlIHRlcm0sCnRoZSBPTFMgZXN0aW1hdG9yIHdpbGwgc29sdmUgcHJlY2lzZWx5IGZvciB0aGUgdHJ1ZSBtb2RlbCB3ZWlnaHRzOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX29sc19kZXRlcm1pbmlzdGljfQpwcmludChvbHMoWCwgeSAtIGUpKQpgYGAKCk9mIGNvdXJzZSBpbiB0aGUgcmVhbCB3b3JsZCB0aGUgbm9pc2UgdGVybSBjYW5ub3QgYmUgZGV0ZXJtaW5lZCBhbmQgdXN1YWxseSB0aGUgZmVhdHVyZSBhbG9uZSBjYW5ub3QgZXhwbGFpbiBlbnRpcmVseSB0aGUgdmFyaWF0aW9uIGluIHRoZSBvdXRjb21lLgpUaGlzIG1lYW5zIHRoYXQgd2hhdCB3ZSBhY3R1YWxseSBlc3RpbWF0ZSB3aWxsIGJlIHRoZSBleHBlY3RlZCB2YWx1ZSBvZiBtb2RlbCB3ZWlnaHRzOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX29sc193aXRoX2Vwc2lsb259CnByaW50KG9scyhYLCB5KSkKYGBgCgpXZSBjYW4gY2hlY2sgdGhlIHJlc3VsdCBmcm9tIFtgc2tsZWFybmBdKGh0dHBzOi8vc2Npa2l0LWxlYXJuLm9yZy8pOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX3NrbGVhcm59CmZyb20gc2tsZWFybi5saW5lYXJfbW9kZWwgaW1wb3J0IExpbmVhclJlZ3Jlc3Npb24KIyBXZSBzZXQgZml0X2ludGVyY2VwdD1GYWxzZSBzaW5jZSBvdXIgZGVzaWduIG1hdHJpeCBhbHJlYWR5IGNvbnRhaW5zIGludGVyY2VwdC4KcHJpbnQoTGluZWFyUmVncmVzc2lvbihmaXRfaW50ZXJjZXB0PUZhbHNlKS5maXQoWCwgeSkuY29lZl8pCmBgYAoKQnkgdGhlIFtMYXcgb2YgTGFyZ2UgTnVtYmVyXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9MYXdfb2ZfbGFyZ2VfbnVtYmVycykgYW5kIFtDZW50cmFsIExpbWl0IFRoZW9yZW1dKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0NlbnRyYWxfbGltaXRfdGhlb3JlbSksCnVuZGVyIGEgcmVsYXRpdmVseSBsb29zZSBhc3N1bXB0aW9uIG9mICRFKFxlcHNpbG9uIHwgWCkgPSAwJCwKdGhlIE9MUyBlc3RpbWF0b3Igd2lsbCBjb252ZXJnZSBpbiBwcm9iYWJpbGl0eSB0byB0aGUgdHJ1ZSBtb2RlbCB3ZWlnaHRzIGFuZCBkaXN0cmlidXRlZCBhc3ltcHRvdGljYWxseSBOb3JtYWwgaW4gbGFyZ2Ugc2FtcGxlLl5bT25lIGNhbiB0cnkgY2hhbmdlIHRoZSBzYW1wbGUgc2l6ZSBhcmJpdHJhcmlseSB0byBzZWUgdGhlIGJlaGF2aW9yIG9mIHRoZSBlc3RpbWF0b3IgaW4gb3VyIHRveSBleGFtcGxlLl0KClRoZSBpc3N1ZSBvZiB0aGUgYWJvdmUgYXBwcm9hY2ggaXMgdGhhdCBlcXVhdGlvbiAkXGVxcmVme2VxOm9sc30kIGlzIG5vdCBudW1lcmljYWxseSBzdGFibGUgd2hlbiBpdCBjb21lcyB0byBsYXJnZS1zY2FsZSBhcHBsaWNhdGlvbiB3aGVyZSB3ZSBtYXkgaGF2ZSBsb3RzIG9mIG9ic2VydmF0aW9ucyBhbmQgbG90cyBvZiBmZWF0dXJlcy4KT25lIHZlcnkgdXNlZnVsIHNvbHV0aW9uIHRvIHNvbHZlIHRoZSBlc3RpbWF0b3IgbnVtZXJpY2FsbHkgaW4gbGFyZ2Utc2NhbGUgYXBwbGljYXRpb24gaXMgdGhlICpncmFkaWVudCBkZXNjZW50KiBhcHByb2FjaC4KCiMjIyBHcmFkaWVudCBEZXNjZW50IHdpdGggTWVhbiBTcXVhcmVkIEVycm9yCgpJbnN0ZWFkIG9mIHNvbHZpbmcgdGhlIGZpcnN0LW9yZGVyIGNvbmRpdGlvbiBhbmFseXRpY2FsbHksCndlIGNhbiBkbyBpdCBudW1lcmljYWxseS4KR3JhZGllbnQgZGVzY2VudCBpcyBhIDFzdC1vcmRlciBvcHRpbWl6YXRpb24gdGVjaG5pcXVlIHRvIGZpbmQgbG9jYWwgb3B0aW11bSBvZiBhIGdpdmVuIGZ1bmN0aW9uLgoKSW4gdGhlIG1vZGVsIHRyYWluaW5nIGV4ZXJjaXNlIG91ciB0YXJnZXQgZnVuY3Rpb24gaXMgdGhlIGxvc3Mgc28gdGhlIG9wdGltaXphdGlvbiBwcm9ibGVtIGlzOgoKJCQKXG9wZXJhdG9ybmFtZSp7YXJnbWlufV9cYmV0YSBcbWJveHtMb3NzfSA9IFxmcmFjezF9e059XHN1bV9pKHlfaSAtIFxiZXRhIHhfaSleMi4KJCQKClRoYXQgaXMsCndlJ2QgbGlrZSB0byBmaWd1cmUgb3V0IG1vZGVsIHdlaWdodHMgdGhhdCBtaW5pbWl6ZSB0aGUgbG9zcyB3aGljaCBpcyBkZWZpbmVkIGJ5IHRoZSBtZWFuIHNxdWFyZWQgZXJyb3JzIHdoZW4gdGhlIG1vZGVsIGlzIGEgcmVncmVzc2lvbiBtb2RlbC4KClRoZSBpZGVhIG9mIGdyYWRpZW50IGRlc2NlbnQgaXMgdG8KCjEuIERlcml2ZSB0aGUgZnVuY3Rpb25hbCBmb3JtIG9mIHRoZSBncmFkaWVudCBvZiBsb3NzIHcuci50LiB0byBhbGwgd2VpZ2h0cwoyLiBJbml0aWFsaXplIGFsbCBtb2RlbCB3ZWlnaHRzIHJhbmRvbWx5CjMuIENhbGN1bGF0ZSB0aGUgZ3JhZGllbnQgdmFsdWUgdXNpbmcgdGhlIGFjdHVhbCBkYXRhIGFuZCB0aGUgY3VycmVudCB2YWx1ZSBvZiB3ZWlnaHRzCjQuIFVwZGF0ZSB0aGUgd2VpZ2h0cyBieSAocGFydGlhbGx5KSB0aGUgYW1vdW50IG9mIGdyYWRpZW50IGp1c3QgY2FsY3VsYXRlZAo1LiBSZXBlYXQgMyBhbmQgNCB1bnRpbCB0aGUgcmVzdWx0aW5nIGdyYWRpZW50cyBiZWNvbWUgc21hbGwgZW5vdWdoCgpMZXQncyB1c2UgdGhlIHRveSBleGFtcGxlIHRvIGFjdHVhbGx5IGltcGxlbWVudCBhIGdyYWRlbnQgZGVzY2VudCBvcHRpbWl6ZXIgZnJvbSBzY3JhdGNoLgpGaXJzdCB3ZSByZS13cml0ZSB0aGUgbG9zcyBmdW5jdGlvbiBleHBsaWNpdGx5IHdpdGggb3VyIHNldHVwIG9mIG9uZSBjb2VmZmljaWVudCB3aXRoIGEgY29uc3RhbnQgKCRcYmV0YSA9IFtcYmV0YV8wLCBcYmV0YV8xXSQpOgoKJCQKXG1ib3h7TG9zc30gPSBcZnJhY3sxfXtOfVxzdW1faVxiaWdbeV9pLShcYmV0YV8wICsgXGJldGFfMXhfaSlcYmlnXV4yLgokJAoKTm93IHRoZSBncmFkaWVudCAob3IgZXF1aXZhbGVudGx5IHRoZSAxc3Qtb3JkZXIgZGVyaXZhdGl2ZSkgdy5yLnQuIHRvIHdlaWdodHMgd2lsbCBiZToKCiQkClxiZWdpbnthbGlnbmVkfQpcZnJhY3tccGFydGlhbFxtYm94e0xvc3N9fXtccGFydGlhbFxiZXRhXzB9IAomPSAtIFxmcmFjezJ9e059XHN1bV9pIFxiaWdbIHlfaSAtIChcYmV0YV8wICsgXGJldGFfMXhfaSkgXGJpZ10sIFxcClxmcmFje1xwYXJ0aWFsXG1ib3h7TG9zc319e1xwYXJ0aWFsXGJldGFfMX0gCiY9IC0gXGZyYWN7Mn17Tn1cc3VtX2kgXGJpZ1sgeV9pIC0gKFxiZXRhXzAgKyBcYmV0YV8xeF9pKSBcYmlnXXhfaS4KXGVuZHthbGlnbmVkfQokJAoKVGhlIGNvcnJlc3BvbmRpbmcgcHl0aG9uIGZ1bmN0aW9uIGNhbiBiZSBjb2RlZCBhczoKCmBgYHtweXRob24gbGluZWFyX3JlZ19ncmFkX2Z1bmN9CmRlZiBncmFkX2Z1bmMoWCwgeSwgYmV0YSk6CiAgIiIiQ2FsY3VsYXRlIHZlY3Rvcml6ZWQgZ3JhZGllbnRzLiIiIgogIHJldHVybiAtMiAqICgoeSAtIFguZG90KGJldGEpKS5kb3QoWCkpIC8gWC5zaGFwZVswXQpgYGAKCklmIHdlIHNldCB0aGUgYWJvdmUgZXF1YXRpb25zIHRvIHplcm8gd2UgY2FuIHNvbHZlIGZvciAkXGJldGFfMCQgYW5kICRcYmV0YV8xJCBhbmFseXRpY2FsbHkgYW5kIHRoZSBzb2x1dGlvbiB3aWxsIGJlIGV4YWN0bHkganVzdCBlcXVhdGlvbiAkXGVxcmVme2VxOm9sc30kLgpCdXQgYXMgd2UganVzdCBwb2ludGVkIG91dCBpdCBzdWZmZXJzIGZyb20gbnVtZXJpY2FsIHN0YWJpbGl0eSBpc3N1ZS4KClRoZSBtaW5pbXVtIGltcGxlbWVudGF0aW9uIG9mIG91ciBncmFkaWVudCBkZXNjZW50IG9wdGltaXplciBpcyBqdXN0IGEgZmV3IGxpbmVzOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX2dkfQpkZWYgZ2Rfb3B0aW1pemUoWCwgeSwgZ3JhZF9mdW5jLCBscj0uMDEsIG5fc3RlcD0xMDApOgogIGIgPSBucC5yYW5kb20ubm9ybWFsKHNpemU9WC5zaGFwZVsxXSkKICBvdXQgPSBiLmNvcHkoKQogIGZvciBzdGVwIGluIHJhbmdlKG5fc3RlcCk6CiAgICBiIC09IGxyICogZ3JhZF9mdW5jKFgsIHksIGIpCiAgICBvdXQgPSBucC5yb3dfc3RhY2soW291dCwgYl0pICAjIFRyYWNlIHJlc3VsdCBvZiBlYWNoIHN0ZXAuCiAgcmV0dXJuIG91dAoKYiA9IGdkX29wdGltaXplKFgsIHksIGdyYWRfZnVuYywgbl9zdGVwPTMwMDApCmZvciBzIGluIFsxMCwgNTAsIDEwMCwgNTAwLCAxMDAwLCAzMDAwXToKICBwcmludCgiVHJhaW5pbmcgU3RlcHMgezo1fSB8IEVzdGltYXRlOiB7fSIuZm9ybWF0KHMsIGJbc10pKQpgYGAKCkFzIHdlIGNhbiBzZWUgdGhlIHJlc3VsdCBpcyBhcHByb2FjaGluZyB0byBvdXIgYW5hbHl0aWNhbCBzb2x1dGlvbiBhcyB0aGUgbnVtYmVyIG9mIHN0ZXBzIGdyb3dzLgoKIyMjIyBPbiBMZWFybmluZyBSYXRlIHstfQoKTGVhcm5pbmcgcmF0ZSBpcyBhIGh5cGVyLXBhcmFtZXRlciBmb3IgZ3JhZGllbnQgZGVzY2VudCBvcHRpbWl6ZXIuClRoZSBncmFkaWVudCB1cGRhdGUgdG8gb3VyIG1vZGVsIHdlaWdodHMgaXMgc2NhbGVkIGRvd24gYnkgdGhlIGxlYXJuaW5nIHJhdGUgdG8gbWFrZSBzdXJlIGNvbnZlcmdlbmNlLgpUb28gbGFyZ2UgdGhlIGxlYXJuaW5nIHJhdGUgd2lsbCBleHBsb2RlIHRoZSBncmFkaWVudC4KVG9vIHNtYWxsIHRoZSBsZWFybmluZyByYXRlIHdpbGwgc2xvdyBkb3duIHRoZSBjb252ZXJnZW5jZSBhbmQgc29tZXRpbWVzIHJlc3VsdCBpbiB0aGUgb3B0aW1pemVyIHRyYXBwZWQgYXQgbG9jYWwgc3ViLW9wdGltdW0uCgpMZXQncyByZS13cml0ZSBvdXIgZ3JhZGllbnQgZGVzY2VudCBvcHRpbWl6ZXIgdG8gYWxzbyB0cmFjayB0aGUgbG9zcyBmcm9tIGVhY2ggdHJhaW5pbmcgc3RlcC4KQW5kIHdlIHVzZSB0aGUgc2FtZSBpbml0aWFsaXphdGlvbiBmb3IgYSBmYWlyIGNvbXBhcmlzb24uCgpgYGB7cHl0aG9uIGxpbmVhcl9yZWdfZ2Rfd2l0aF9sb3NzfQpkZWYgbG9zcyhYLCB5LCBiZXRhKToKICByZXR1cm4gKChYLmRvdChiZXRhKSAtIHkpKioyKS5tZWFuKCkKCmRlZiBnZF9vcHRpbWl6ZShYLCB5LCBncmFkX2Z1bmMsIGxyPS4wMSwgbl9zdGVwPTEwMCk6CiAgYiA9IG5wLmFycmF5KFswLjAsIDAuMF0pCiAgbCA9IFtsb3NzKFgsIHksIGIpXQogIGZvciBzdGVwIGluIHJhbmdlKG5fc3RlcCk6CiAgICBiIC09IGxyKmdyYWRfZnVuYyhYLCB5LCBiKQogICAgbC5hcHBlbmQobG9zcyhYLCB5LCBiKSkKICByZXR1cm4gYiwgbApgYGAKCk5vdyB3ZSBydW4gdGhlIG9wdGltaXphdGlvbiB3aXRoIGEgdmFyaWV0eSBvZiBkaWZmZXJlbnQgbGVhcm5pbmcgcmF0ZXMuCkZvciBpbGx1c3RyYXRpb24gcHVycG9zZSB3ZSB3aWxsIG9ubHkgcnVuIGEgZmV3IHN0ZXBzLgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX2RpZmZfbHJ9CmJldGFzID0ge30KbG9zc2VzID0ge30KZm9yIGxyIGluIFsuMDAxLCAuMDEsIC4wNSwgLjEsIDFdOgogIGJldGFzW2xyXSwgbG9zc2VzW2xyXSA9IGdkX29wdGltaXplKFgsIHksIGdyYWRfZnVuYywgbHI9bHIsIG5fc3RlcD0xNSkKCmZvciByLCBiIGluIGJldGFzLml0ZW1zKCk6CiAgcHJpbnQoIkxlYXJuaW5nIFJhdGUgezo1fSB8IEVzdGltYXRlOiB7fSIuZm9ybWF0KHIsIGIpKQpgYGAKClRoZSByZXN1bHQgc3VnZ2VzdHMgdGhhdCBhIGxlYXJuaW5nIHJhdGUgb2YgMSBpcyB0b28gbGFyZ2UgZm9yIG91ciBwcm9ibGVtLgpUaGUgZ3JhZGllbnQgZXhwbG9kZXMgd2hpY2ggbWFrZSBvdXIgc29sdXRpb24gZGl2ZXJnZS4KQW5kIGEgbG93ZXIgbGVhcm5pbmcgcmF0ZSBpbiBnZW5lcmFsIGNvbnZlcmdlcyBzbG93ZXIgdG8gdGhlIG9wdGltdW0uCk51bWJlciBvZiBleGFtcGxlcyB1c2VkIHRvIGNhbGN1bGF0ZSB0aGUgZ3JhZGllbnQgYWxzbyB3aWxsIGFmZmVjdCB0aGUgY29udmVyZ2VuY2UgYmVoYXZpb3IuCkluIGdlbmVyYWwgaWYgdGhlIHNhbXBsZSBzaXplIGlzIHRvbyBzbWFsbCBhIHNtYWxsZXIgbGVhcm5pbmcgcmF0ZSBzaG91bGQgYmUgdXNlZCB0byBhdm9pZCBncmFkaWVudCBleHBsb3Npb24uCgpUaGlzIGNhbiBiZSBtb3JlIGNsZWFybHkgc2VlbiBpZiB3ZSBwbG90IHRoZSB0cmFjZSBvZiBvdXIgdHJhaW5pbmcgbG9zc2VzOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX2RpZmZfbHJfcGxvdH0Kb2ZpbGUgPSAicGxvdHMvdG95X3JlZ19sb3NzX2NvbXBhcmUuaHRtbCIKcGRhdGEgPSBbZ28uU2NhdHRlcih4PW5wLmFyYW5nZShsZW4obG9zc2VzW2xyXSkpLCB5PWxvc3Nlc1tscl0sIG5hbWU9bHIpIAogICAgICAgICBmb3IgbHIgaW4gbG9zc2VzLmtleXMoKV0KcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPXBkYXRhLAogIGxheW91dD1nby5MYXlvdXQoCiAgICB0aXRsZT0iVHJhY2Ugb2YgVHJhaW5pbmcgTG9zcyB3aXRoIFZhcmlvdXMgTGVhcm5pbmcgUmF0ZXMiLAogICAgeGF4aXM9ZGljdCh0aXRsZT0iU3RlcCIpLAogICAgeWF4aXM9ZGljdCh0aXRsZT0iTG9zcyIpKSkKYGBgCgpgYGB7ciwgZWNobz1GQUxTRX0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpJZiB0aGUgbG9zcyBkb2Vzbid0IGRlY3JlYXNlIG92ZXIgdHJhaW5pbmcgaXRlcmF0aW9uLAppdCBpcyBhIHNpZ25hbCB0aGF0IHNvbWV0aGluZyBpcyB3cm9uZyB3aXRoIG91ciBtb2RlbC4KClVubGlrZSBvdXIgdG95IGltcGxlbWVudGF0aW9uLAppbiBtb2Rlcm4gaW1wbGVtZW50YXRpb24gb2YgYW55IG51bWVyaWNhbCBvcHRpbWl6ZXIgdGhlcmUgd2lsbCBiZSBhIGxvdCBvZiB0ZWNobmlxdWVzIHRvIGRvIHRoZSBiZXN0IHRvIGF2b2lkIGNvbnZlcmdlbmNlIGZhaWx1cmUuCkJ1dCBpdCBpcyB0aGUgbW9kZWwgZGV2ZWxvcGVyJ3MgcmVzcG9uc2liaWxpdHkgdG8gZGlhZ25vc2UgdGhlIHRyYWluaW5nIGJlaGF2aW9yIGJlZm9yZSBhbnl0aGluZyBpcyBkZWxpdmVyZWQgdG8gdGhlIHN0YWtlaG9sZGVyLgpDaGVja2luZyB0aGUgZHluYW1pY3Mgb2YgbG9zcyBpcyB1c3VhbGx5IHRoZSBmaXJzdCBhbmQgcXVpY2sgc3RlcCB0byBleGFtaW5lIHdoZXRoZXIgdGhlIHRyYWluaW5nIHRhc2sgaXMgZnVuY3Rpb25pbmcgYXMgZXhwZWN0ZWQuCgojIyMjIFN0b2NhaHN0aWMgR3JhZGllbnQgRGVzY2VudCB7LX0KClRoZSB2YW5pbGxhIGdyYWRpZW50IGRlc2NlbnQgb3B0aW1pemVyIHdlIGp1c3QgaW1wbGVtZW50ZWQgaGFzIG9uZSBpc3N1ZS4KU2luY2UgZm9yIGVhY2ggdXBkYXRlIGl0IG5lZWRzIHRvIHRyYXZlcnNlIG92ZXIgdGhlIGVudGlyZSBkYXRhc2V0LAppdCBiZWNvbWVzIHRvbyBzbG93IHdoZW4gaXQgY29tZXMgdG8gbGFyZ2UgZGF0YXNldC4KClN0b2NoYXN0aWMgZ3JhZGllbnQgZGVzY2VudCBpcyB0byBvdmVyY29tZSB0aGlzIGlzc3VlLgpJbnN0ZWFkIG9mIGNhbGN1bGF0ZSB0aGUgZ3JhZGllbnQgdXNpbmcgdGhlIGVudGlyZSBkYXRhc2V0LAp3ZSBjYW4gdXNlIG9ubHkgb25lIGV4YW1wbGUgcGVyIHVwZGF0ZS4KRWFjaCBzdGVwIHdpbGwgYmUgbGVzcyBwcmVjaXNlIGJ1dCBzdGF0aXN0aWNhbGx5IHRoZSBmaW5hbCByZXN1bHQgc2hvdWxkIGJlIGNvbnNpc3RlbnQuCgpIZXJlIHdlIGludHJvZHVjZSB0aGUgdGVybSAqZXBvY2gqOgpPbmUgZXBvY2ggaXMgZm9yIHRoZSBvcHRpbWl6ZXIgdG8gdHJhdmVyc2UgdGhlIGVudGlyZSBkYXRhc2V0IG9uY2UuCk51bWJlciBvZiBlcG9jaHMgY2FuIGJlIGNvbnNpZGVyZWQgYXMgYW5vdGhlciBoeXBlci1wYXJhbWV0ZXIgb2YgYSBtb2RlbC4KCkhlcmUgY29tZXMgdGhlIG1pbmltdW0gU0dEIGltcGxlbWVudGF0aW9uOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX3NnZH0KZGVmIHNnZF9vcHRpbWl6ZShYLCB5LCBncmFkX2Z1bmMsIGxyPS4wMSwgbl9lcG9jaD0xMCk6CiAgYiA9IG5wLnJhbmRvbS5ub3JtYWwoc2l6ZT1YLnNoYXBlWzFdKQogIGwgPSBbbG9zcyhYLCB5LCBiKV0KICBvdXQgPSBiLmNvcHkoKQogIGZvciBlcG9jaCBpbiByYW5nZShuX2Vwb2NoKToKICAgICMgU2h1ZmZsZSB0aGUgZGF0YXNldCBiZWZvcmUgZWFjaCBlcG9jaC4KICAgIHNpZCA9IG5wLnJhbmRvbS5wZXJtdXRhdGlvbihYLnNoYXBlWzBdKQogICAgZm9yIGkgaW4gc2lkOgogICAgICBiIC09IGxyICogZ3JhZF9mdW5jKFhbTm9uZSxpLDpdLCB5W2ldLCBiKQogICAgICBsLmFwcGVuZChsb3NzKFhbTm9uZSxpLDpdLCB5W2ldLCBiKSkKICAgICMgVHJhY2UgdGhlIHJlc3VsdCBwZXIgZXBvY2guCiAgICBvdXQgPSBucC5yb3dfc3RhY2soW291dCwgYl0pCiAgcmV0dXJuIG91dCwgbAoKc2dkX2JldGEsIHNnZF9sb3NzID0gc2dkX29wdGltaXplKFgsIHksIGdyYWRfZnVuYywgbHI9LjAxLCBuX2Vwb2NoPTEwMCkKZm9yIGVwb2NoIGluIFsxLCA1LCAxMCwgNTAsIDEwMF06CiAgcHJpbnQoIlRyYWluaW5nIEVwb2NocyB7OjR9IHwgRXN0aW1hdGU6IHt9Ii5mb3JtYXQoZXBvY2gsIHNnZF9iZXRhW2Vwb2NoXSkpCmBgYAoKU0dEIHdvbid0IGJlIGFzIHByZWNpc2UgYXMgdmFuaWxsYSBHRCBidXQgZm9yIGxhcmdlIHNjYWxlIGFwcGxpY2F0aW9uIGl0IGNhbiByZWR1Y2UgY29uc2lkZXJhYmxlIGFtb3VudCBvZiBjb21wdXRpbmcgdGltZSAoc29tZXRpbWVzIGZyb20gaW5mZWFzaWJsZSB0byBmZWFzaWJsZSkuCkluIG91ciBzaW1wbGUgcHJvYmxlbSBpbmRlZWQganVzdCAxIGVwb2NoIGNhbiBoYXZlIGEgZ29vZCBhcHByb3hpbWF0aW9uIGFscmVhZHkuCgpUaGUgdHJhY2Ugb2YgKHBlci1pbnN0YW5jZSkgbG9zcyBmb3IgdGhlIGZpcnN0IDUwMCB1cGRhdGVzOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX3NnZF9wbG90fQpvZmlsZSA9ICJwbG90cy90b3lfcmVnX3NnZF9sb3NzLmh0bWwiCnAgPSBwbG90X29mZmxpbmUoCiAgb2ZpbGU9b2ZpbGUsCiAgZGF0YT1bZ28uU2NhdHRlcih4PW5wLmFyYW5nZShsZW4oc2dkX2xvc3NbOjUwMF0pKSwgeT1zZ2RfbG9zc1s6NTAwXSldLAogIGxheW91dD1nby5MYXlvdXQoCiAgICB0aXRsZT0iVHJhY2Ugb2YgU0dEIFRyYWluaW5nIExvc3MiLAogICAgeGF4aXM9ZGljdCh0aXRsZT0iU3RlcCIpLAogICAgeWF4aXM9ZGljdCh0aXRsZT0iTG9zcyIpKSkKYGBgCgpgYGB7ciwgZWNobz1GQUxTRX0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpTaW5jZSB0aGUgbG9zcyBpcyBjYWxjdWxhdGVkIG9uIGEgcGVyLWluc3RhbmNlIGJhc2lzLAppdCB3aWxsIGZsdWN0dWF0ZSBidXQgd2l0aCBhIGRlY3JlYXNpbmcgdHJlbmQgaWYgbm90aGluZyB3ZW50IHdyb25nIGFib3V0IHRoZSBvcHRpbWl6YXRpb24gcHJvY2Vzcy4KCkluIGBza2xlYXJuYCB0aGVyZSBhcmUgZGVkaWNhdGVkIFNHRCBjbGFzc2VzIGZvciBhIHZhcmlldHkgb2YgbGVhcm5pbmcgYWxnb3JpdGhtcy4KRm9yIGEgbGluZWFyIHJlZ3Jlc3Npb24gbW9kZWwgd2l0aCBTR0Qgc29sdmVyOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX3NnZF9za2xlYXJufQpmcm9tIHNrbGVhcm4ubGluZWFyX21vZGVsIGltcG9ydCBTR0RSZWdyZXNzb3IKIyBUdXJuIG9mZiB0aGUgZGVmYXVsdCBlbGFzdGljbmV0IHJlZ3VsYXJpemF0aW9uIGZvciBjb21wYXJpc29uLgpwcmludChTR0RSZWdyZXNzb3IoYWxwaGE9MCwgbDFfcmF0aW89MCwgZml0X2ludGVyY2VwdD1GYWxzZSkuZml0KFgsIHkpLmNvZWZfKQpgYGAKCiMjIyMgQmF0Y2ggR3JhZGllbnQgRGVzY2VudCB7LX0KClRvIHJlZHVjZSB0aGUgbm9pc2UgaW4gU0dEIHdlIGNhbiBtb2RpZnkgaXQgYnkgcmVwbGFjaW5nIDEgdHJhaW5pbmcgZXhhbXBsZSB3aXRoIGEgYmF0Y2ggb2YgZXhhbXBsZXMgaW4gYSBzaW5nbGUgZ3JhZGllbnQgdXBkYXRlLgpIZXJlJ3Mgc3VjaCBpbXBsZW1lbnRhdGlvbiBvZiBhIGJhdGNoIGdyYWRpZW50IGRlc2NlbnQgb3B0aW1pemVyXltTb21ldGltZXMgIm1pbmktYmF0Y2ggZ3JhZGllbnQgZGVzY2VudCIgaXMgdXNlZCB0byBkZXNjcmliZSBTR0Qgd2l0aCBiYXRjaCBzaXplID4gMS4gSGVyZSB3ZSBpZ25vcmUgdGhlIHJlZHVuZGFudCB3b3JkaW5nIGFuZCBqdXN0IGNhbGwgaXQgYmF0Y2ggZ3JhZGllbnQgZGVzY2VudC5dOgoKYGBge3B5dGhvbiBsaW5lYXJfcmVnX2dkX2JhdGNofQpkZWYgZ2RfYmF0Y2hfb3B0aW1pemUoWCwgeSwgZ3JhZF9mdW5jLCBscj0uMDEsIG5fZXBvY2g9MTAsIGJhdGNoX3NpemU9NjQpOgogIGIgPSBucC5yYW5kb20ubm9ybWFsKHNpemU9WC5zaGFwZVsxXSkKICBsID0gW2xvc3MoWCwgeSwgYildCiAgZm9yIGVwb2NoIGluIHJhbmdlKG5fZXBvY2gpOgogICAgIyBTaHVmZmxlIHRoZSBkYXRhc2V0IGJlZm9yZSBlYWNoIGVwb2NoLgogICAgc2lkID0gbnAucmFuZG9tLnBlcm11dGF0aW9uKFguc2hhcGVbMF0pCiAgICBYcyA9IFhbc2lkLDpdCiAgICB5cyA9IHlbc2lkXQogICAgaSA9IDAKICAgIG5fc3RlcCA9IGludChucC5jZWlsKFguc2hhcGVbMF0gLyBiYXRjaF9zaXplKSkKICAgIGZvciBzdGVwIGluIHJhbmdlKG5fc3RlcCk6CiAgICAgIFhiID0gWHNbaTppK2JhdGNoX3NpemUsOl0KICAgICAgeWIgPSB5c1tpOmkrYmF0Y2hfc2l6ZV0KICAgICAgYiAtPSBscipncmFkX2Z1bmMoWGIsIHliLCBiKQogICAgICBsLmFwcGVuZChsb3NzKFhiLCB5YiwgYikpCiAgICAgIGkgKz0gYmF0Y2hfc2l6ZQogIHJldHVybiBiLCBsCgpiYXRjaF9iZXRhLCBiYXRjaF9sb3NzID0gZ2RfYmF0Y2hfb3B0aW1pemUoWCwgeSwgZ3JhZF9mdW5jLCBuX2Vwb2NoPTEwMCwgYmF0Y2hfc2l6ZT02NCkKcHJpbnQoYmF0Y2hfYmV0YSkKYGBgCgpGb3IgdGhpcyBzaW1wbGUgcHJvYmxlbSBiYXRjaCBzaXplIGRvZXNuJ3QgaGF2ZSBhbnkgaW1wb3J0YW50IGltcGFjdCBnaXZlbiBlbm91Z2ggbnVtYmVyIG9mIHRyYWluaW5nIGVwb2NoczoKCmBgYHtweXRob24gbGluZWFyX3JlZ19nZF9kaWZmX2JhdGNoX3NpemV9CmZvciBic2l6ZSBpbiBbOCwgMTYsIDMyLCA2NCwgMTI4LCAyNTZdOgogIHByaW50KCJCYXRjaCBTaXplOiB7OjR9IHwgRXN0aW1hdGU6IHt9Ii5mb3JtYXQoCiAgICBic2l6ZSwKICAgIGdkX2JhdGNoX29wdGltaXplKFgsIHksIGdyYWRfZnVuYywgbl9lcG9jaD0xMDAsIGJhdGNoX3NpemU9YnNpemUpWzBdKSkKYGBgCgpCYXRjaCBvcHRpbWl6ZXIgaXMgY3VycmVudGx5IHRoZSBiZXN0IHByYWN0aWNlIG9mIHRyYWluaW5nIG5ldXJhbCBuZXR3b3JrcyBpbiBsYXJnZSBzY2FsZSBhcHBsaWNhdGlvbi4KVGhlIGJhdGNoIHNpemUgZGVwZW5kcyBvbiB0aGUgYWN0dWFsIGFwcGxpY2F0aW9uIGJ1dCB1c3VhbGx5IHJhbmdlcyBmcm9tIDggKG1pbmkpIHRvIDEwMjQgKGxhcmdlKS4KCiMjIExvZ2lzdGljIFJlZ3Jlc3Npb24KCkEgbG9naXN0aWMgcmVncmVzc2lvbiBtb2RlbHMgdGhlIG91dGNvbWUgcHJvYmFibGlzdGljYWxseToKCiQkClxiZWdpbntlcXVhdGlvbn0gXGxhYmVse2VxOmxvZ2l0fQpQKFkgPSAxKSA9IFxmcmFjezF9ezEgKyBlXnstWFxiZXRhfX0sClxlbmR7ZXF1YXRpb259CiQkCgpIZXJlIHRoZSBzaWdtb2lkIGZ1bmN0aW9uICRzKHQpID0gXGZyYWN7MX17MSArIGVeey10fX0kIGlzIHVzZWQgdG8gdHJhbnNmb3JtIGEgcmVhbCBudW1iZXIgaW50byBwcm9iYWJpbGl0eSBzcGFjZSAkWzAsIDFdJC4KCldlIGNhbiBpbnRlcnByZXQgdGhlIG1vZGVsIGFzIGEgbGluZWFyIG1vZGVsIGluIGxvZy1vZGRzLgpBc3N1bWluZyBZIGlzIGJpbmFyeSBhbmQgdGFrZSBhIHZhbHVlIG9mIDAgb3IgMSwKdGhlIG9kZHMgb2YgJFkgPSAxJCBpcyBkZWZpbmVkIGFzICRcZnJhY3tQKFkgPSAxKX17UChZID0gMCl9ID0gXGZyYWN7UChZID0gMSl9ezEgLSBQKFkgPSAxKX0kLgpXZSBjYW4gcmUtYXJyYW5nZSB0aGUgbG9naXN0aWMgbW9kZWwgZXF1YXRpb246CgokJApcYmVnaW57YWxpZ25lZH0KXGxuIFxCaWdnWyBcZnJhY3tQKFkgPSAxKX17MSAtIFAoWSA9IDEpfSBcQmlnZ10gCiY9IFxsbiBcQmlnZ1sgXGZyYWN7XGZyYWN7MX17MSArIGVeey1YXGJldGF9fX17XGZyYWN7ZV57LVhcYmV0YX19ezEgKyBlXnstWFxiZXRhfX19IFxCaWdnXSBcXAomPSBcbG4oMSArIGVeey1YXGJldGF9KSAtIFxsbiBlXnstWFxiZXRhfSgxICsgZV57LVhcYmV0YX0pIFxcCiY9IFxsbigxICsgZV57LVhcYmV0YX0pIC0gXGxuIGVeey1YXGJldGF9IC0gXGxuKDEgKyBlXnstWFxiZXRhfSkgXFwKJj0gLSBcbG4gZV57LVhcYmV0YX0gXFwKJj0gWFxiZXRhLgpcZW5ke2FsaWduZWR9CiQkCgpUaGF0IGlzLAp0aGUgbW9kZWwgd2VpZ2h0cyBhcmUgbGluZWFyIGluIHRoZSBsb2ctb2RkcyBvZiBvdXIgdGFyZ2V0IG91dGNvbWUuCgpXaGVuIHRoZSBwcm9iYWJpbGl0eSBpcyB0cmFuc2Zvcm1lZCBpbnRvIG9kZHMsCnRoZSByYW5nZSBpcyB0cmFuc2Zvcm1lZCBmcm9tICRbMCwxXSQgdG8gJFswLFxpbmZ0eV0kLgoKYGBge3B5dGhvbiBsb2dpdF9wcm9iX29kZHNfcGxvdH0KIyBXZSBwbG90IG9ubHkgdXAgdG8gLjk1IHNpbmNlIHRoZSB2YWx1ZSBvZiBvZGRzIHdpbGwgZ3JvdyB1bmJvdW5kZWRseS4KcHJvYiA9IG5wLmxpbnNwYWNlKC4wMDEsIC45NSwgbnVtPTEwMCkKb2RkcyA9IHByb2IgLyAoMSAtIHByb2IpCmxvZ19vZGRzID0gbnAubG9nKG9kZHMpCgpvZmlsZSA9ICJwbG90cy9wcm9iX29kZHMuaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVtnby5TY2F0dGVyKHg9cHJvYiwgeT1vZGRzKV0sCiAgbGF5b3V0PWdvLkxheW91dCgKICAgIHRpdGxlPSJFdmVudCBQcm9iYWJpbGl0aWVzIHRvIE9kZHMiLAogICAgeGF4aXM9ZGljdCh0aXRsZT0iUHJvYmFiaWxpdHkiKSwKICAgIHlheGlzPWRpY3QodGl0bGU9Ik9kZHMiKSkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0V9Cmh0bWx0b29sczo6aW5jbHVkZUhUTUwocHkkb2ZpbGUpCmBgYAoKSWYgd2UgZnVydGhlciB0cmFuc2Zvcm0gb2RkcyB0byBsb2ctb2RkcywKdGhlIHJhbmdlIGlzIHRyYW5zZm9ybWVkIGZyb20gJFswLFxpbmZ0eV0kIHRvICRbLVxpbmZ0eSxcaW5mdHldJC4KCmBgYHtweXRob24gbG9naXRfb2Rkc19sb2dvZGRzX3Bsb3R9Cm9maWxlID0gInBsb3RzL3Byb2Jfb2Rkcy5odG1sIgpwID0gcGxvdF9vZmZsaW5lKAogIG9maWxlPW9maWxlLAogIGRhdGE9W2dvLlNjYXR0ZXIoeD1vZGRzLCB5PWxvZ19vZGRzKV0sCiAgbGF5b3V0PWdvLkxheW91dCgKICAgIHRpdGxlPSJFdmVudCBPZGRzIHRvIExvZy1PZGRzIiwKICAgIHhheGlzPWRpY3QodGl0bGU9Ik9kZHMiKSwKICAgIHlheGlzPWRpY3QodGl0bGU9IkxvZy1PZGRzIikpKQpgYGAKCmBgYHtyLCBlY2hvPUZBTFNFfQpodG1sdG9vbHM6OmluY2x1ZGVIVE1MKHB5JG9maWxlKQpgYGAKClB1dCBpdCB0b2dldGhlciBpcyB0aGUgZWZmZWN0IG9mIHRoZSBzaWdtb2lkIGZ1bmN0aW9uOgoKYGBge3B5dGhvbiBsb2dpdF9zaWdtb2lkX3Bsb3R9CiMgTm90ZSB0aGF0IGluc3RlYWQgb2YgY29kaW5nIHMgPSAxIC8gKDEgKyBucC5leHAoLXQpKSwKIyB3aGljaCBpcyBudW1lcmljYWxseSB1bnN0YWJsZSwKIyB3ZSBzaG91bGQgdXNlIGEgbWF0aCB0cmljayB0byBtYWtlIGl0IHN0YWJsZS4KZGVmIHNpZ21vaWQodCk6CiAgIiIiTnVtZXJpY2FsbHkgc3RhYmxlIHNpZ21vaWQuIiIiCiAgcmV0dXJuIG5wLmV4cCgtbnAubG9nYWRkZXhwKDAsIC10KSkKCnQgPSBucC5saW5zcGFjZSgtMTAsIDEwLCBudW09MTAwKQpvZmlsZSA9ICJwbG90cy9zaWdtb2lkLmh0bWwiCnAgPSBwbG90X29mZmxpbmUoCiAgb2ZpbGU9b2ZpbGUsCiAgZGF0YT1bZ28uU2NhdHRlcih4PXQsIHk9c2lnbW9pZCh0KSldLAogIGxheW91dD1nby5MYXlvdXQoCiAgICB0aXRsZT0iQSBTaWdtb2lkIEZ1bmN0aW9uIiwKICAgIHhheGlzPWRpY3QodGl0bGU9IlJhdyBWYWx1ZSIpLAogICAgeWF4aXM9ZGljdCh0aXRsZT0iUHJvYmFiaWxpdHkiKSkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0V9Cmh0bWx0b29sczo6aW5jbHVkZUhUTUwocHkkb2ZpbGUpCmBgYAoKIyMjIENyb3NzIEVudHJvcHkKCkhvdyBkbyB3ZSBzb2x2ZSBmb3IgdGhlIG1vZGVsIHdlaWdodHMgJFxiZXRhJCBpbiBlcXVhdGlvbiAkXGVxcmVme2VxOmxvZ2l0fSQ/CkluIHRoZSBsaW5lYXIgcmVncmVzc2lvbiBtb2RlbCB3ZSBzb2x2ZSBmb3IgdGhlIHdlaWdodHMgYnkgbWluaW1pemluZyB0aGUgbWVhbiBzcXVhcmVkIGVycm9yLgpJbiBsb2dpc3RpYyByZWdyZXNzaW9uIG1vZGVsIHdlIG5lZWQgdG8gZGVmaW5lIG1lYXN1cmVtZW50IGZvciBtb2RlbGluZyBlcnJvciBhcyB3ZWxsLgoKUHV0IGl0IGRpZmZlcmVudGx5LAp3ZSdkIGxpa2UgdG8gY2FsY3VsYXRlIHRoZSBkaXN0YW5jZSBiZXR3ZWVuIG91ciBwcmVkaWN0ZWQgcHJvYmFiaWxpdHkgYW5kIHRoZSByZWFsIGV2ZW50IGxhYmVsIGRpc3RyaWJ1dGlvbiAoY2FsbGVkIHRoZSAqZW1waXJpY2FsIGRpc3RyaWJ1dGlvbiopLgpJbiBpbmZvcm1hdGlvbiB0aGVvcnkgdGhlIGNyb3NzIGVudHJvcHkgaXMgdXNlZCB0byBtZWFzdXJlIHRoZSBkaXN0YW5jZSBiZXR3ZWVuIHR3byBwcm9iYWJpbGl0eSBkaXN0cmlidXRpb24uCgojIyMjIFNoYW5ub24ncyBFbnRyb3B5IGFzIGEgTWVhc3VyZSBvZiBJbmZvcm1hdGlvbiB7LX0KClRoZSBbZW50cm9weV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvRW50cm9weV8oaW5mb3JtYXRpb25fdGhlb3J5KSkgb2YgYSBkaXNjcmV0ZSBwcm9iYWJpbGl0eSBkaXN0cmlidXRpb24gaXMgZGVmaW5lZCBhczoKCiQkClxiZWdpbntlcXVhdGlvbn0gXGxhYmVse2VxOmVudHJvcHl9CkgocCkgPSAtIFxzdW1faSBwX2kgXGxvZ18ycF9pLApcZW5ke2VxdWF0aW9ufQokJAoKd2hlcmUgJHBfaSQgaXMgdGhlIHByb2JhYmlsaXR5IGZvciBldmVudCAkaSQuCkl0IG1lYXN1cmVzIHRoZSB1bmNlcnRhaW50eSBvZiBhIHN0b2NoYXN0aWMgZXZlbnQuCgpUYWtlIGEgY29pbiBmbGlwIGV2ZW50IGFzIGV4YW1wbGUuCldlIHBsb3QgdGhlIGVudHJvcHkgdmFsdWUgYXQgZGlmZmVyZW50IHZhbHVlIG9mIGNvaW4gYmlhcyAodGhlIHByb2JhYmlsaXR5IG9mIGhhdmluZyBhIGhlYWQgaW5zdGVhZCBvZiBhIHRhaWwuKQoKYGBge3B5dGhvbiBsb2dpdF9jb2luX2ZsaXBfZW50cm9weV9wbG90fQpkZWYgZW50cm9weV9iaW5hcnkocCk6CiAgcmV0dXJuIC1wKm5wLmxvZzIocCkgLSAoMSAtIHApKm5wLmxvZzIoMSAtIHApCiAgCnByb2IgPSBucC5saW5zcGFjZSguMDEsIC45OSwgbnVtPTEwMCkKCm9maWxlID0gInBsb3RzL2VudHJvcHkuaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVtnby5TY2F0dGVyKHg9cHJvYiwgeT1lbnRyb3B5X2JpbmFyeShwcm9iKSldLAogIGxheW91dD1nby5MYXlvdXQoCiAgICB0aXRsZT0iRW50cm9weSBvZiBhIEJpbmFyeSBFdmVudCAoQ29pbiBGbGlwKSIsCiAgICB4YXhpcz1kaWN0KHRpdGxlPSJQcm9iYWJpbGl0eSBvZiBhIEhlYWQiKSwKICAgIHlheGlzPWRpY3QodGl0bGU9IkVudHJvcHkiKSkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0V9Cmh0bWx0b29sczo6aW5jbHVkZUhUTUwocHkkb2ZpbGUpCmBgYAoKSXQgaXMgb2J2aW91cyB0aGF0IHRoZSBlbnRyb3B5IG9mIHRoaXMgZXZlbnQgaXMgbWF4aW1pemVkIHdoZW4gdGhlIHByb2JhYmlsaXR5IG9mIGZsaXBwaW5nIGEgaGVhZCBpcyBleGFjdGx5IDAuNS4KQXQgdGhpcyBsZXZlbCB0aGUgZXZlbnQgaGFzIGEgaGlnaGVzdCBsZXZlbCBvZiB1bmNlcnRhaW50eSBpbiBhIHNlbnNlIHRoYXQgaXQgaXMgdGhlIG1vc3QgZGlmZmljdWx0IGNhc2UgdG8gcHJlZGljdCB0aGUgb3V0Y29tZSBvZiBhIGZsaXAuCgpXaGF0IGlzIHRoZSBpbnR1aXRpb24gYmVoaW5kIGVudHJvcHk/CgojIyMjIyAqKlN1cnByaXNhbCBpbiBUZXJtcyBvZiBSYXJpdHkqKiB7LX0KCkluIGVxdWF0aW9uICRcZXFyZWZ7ZXE6ZW50cm9weX0kIHdlIGZpcnN0IG5lZWQgdG8gaW50ZXJwcmV0IHRoZSBzZWVtaW5nbHkgbXlzdGVyaW91cyB0ZXJtICQtXGxvZ18ycF9pJC4KSXQgaXMgdGhlIGxvZyBvZiB0aGUgcmVjaXByb2NhbCBvZiBhIHByb2JhYmlsaXR5LgpHZW5lcmFsbHkgc3BlYWtpbmcsCnRoZSByZWNpcHJvYWwgb2YgYSBwcm9iYWJpbGl0eSAkXGZyYWN7MX17cCh4KX0kIGlzIGEgKjEtaW4tbiogc2NhbGUgb2YgcHJvYmFiaWxpdHkgc3RhdGVtZW50IHNheWluZyB0aGF0IGluIG9yZGVyIGZvciB0aGUgb3V0Y29tZSAkeCQgdG8gb2NjdXIgYXQgbGVhc3Qgb25jZSBmcm9tIGEgc3RvY2hhc3RpYyBldmVudCwKaXQgaXMgZXhwZWN0ZWQgdG8gcmVxdWlyZSBoYXZpbmcgcmVwZWF0ZWQgJG4gPSBcZnJhY3sxfXtwKHgpfSQgdGltZXMgdGhlIGV2ZW50LgpUaGUgcmFyZSB0aGUgb3V0Y29tZSwKdGhlIGhpZ2hlciB0aGUgcmVjaXByb2NhbCBvZiBpdHMgcHJvYmFiaWxpdHkuCldoZW4gYSByYXJlIGV2ZW50IG9jY3VycywKaXQgY29udGFpbnMgbXVjaCBtb3JlIGluZm9ybWF0aW9uIHRoYW4gYSBmcmVxdWVudCAob3IgbW9yZSBwcm9iYWJsZSkgb25lLgpJbmZvcm1hdGlvbiBpbiB0aGlzIHdheSBjYW4gYmUgY29uc2lkZXJlZCBhcyB0aGUgbGV2ZWwgb2YgKnN1cnByaXNhbCouCgojIyMjIyAqKkluZm9ybWF0aW9uIEVuY29kaW5nKiogey19CgpCdXQgd2h5IHRha2luZyBsb2c/CkVzcGVjaWFsbHkgd2h5IGxvZyBvZiBiYXNlICp0d28qIGluIFNoYW5ub24ncyBlbnRyb3B5PwpUaGlzIHJlbGF0ZXMgdG8gdGhlIHVzZSBvZiAqYml0cyogdG8gZW5jb2RlIG1lc3NhZ2VzL2luZm9ybWF0aW9uL3JhbmRvbSBzdGF0ZXMvZmFjdHMuCkEgYml0ICgwIG9yIDEpIGNhbiBiZSB1c2VkIHRvIGVuY29kZSAqdHdvKiBmYWN0cy4KRm9yIGV4YW1wbGUsCjAgZm9yIGEgdGFpbCBhbmQgMSBmb3IgYSBoZWFkIGluIGEgY29pbiBmbGlwIGV4ZXJjaXNlLgpBcHBhcmVudGx5IGlmIHdlIGhhdmUgJE4kIGJpdHMgd2UgY2FuIGVuY29kZSB1cCB0byAkMl5OJCBkaWZmZXJlbnQgb3V0Y29tZXMgaW4gYSBzdG9jaGFzdGljIGV2ZW50LgoKVGhlIGRpc2N1c3Npb24gZG9lc24ndCBsaW1pdCB0byBiaW5hcnkuCklmIHdlIGhhdmUgMTAwIHBvc3NpYmxlIG91dGNvbWVzIGZyb20gYSByYW5kb20gZXZlbnQsCndpdGggMTAgZGlzdGluY3Qgc3ltYm9scyAoMCB0byA5KSwKd2Ugb25seSBuZWVkICRcbG9nX3sxMH0xMDAgPSAyJCBkaWdpdHMgdG8gZW5jb2RlIHRoZW0gKGRlY2ltYWwgMCB0byA5OSkuCgpOb3cgcHV0IHRoZW0gdG9nZXRoZXIsCnRoZSByYXJlIHRoZSBvdXRjb21lLAp0aGUgaGlnaGVyIHRoZSByZWNpcHJvY2FsIG9mIGl0cyBwcm9iYWJpbGl0eSwKYW5kIHRoZSBtb3JlIGJpdHMgcmVxdWlyZWQgdG8gZW5jb2RlIHRoaXMgaW5mb3JtYXRpb24gKHNvIGFzIHRvIGRpc3Rpbmd1aXNoIGZyb20gb3RoZXIgcG9zc2libGUgb3V0Y29tZXMpLgoKVGhlIGZvcm11bGEgJFxsb2dfMlxmcmFjezF9e1AoeCl9JCBjYWxjdWxhdGVzIGhvdyBtYW55IGJpdHMgYXJlIG5lY2Vzc2FyeSB0byBlbmNvZGUgYSBzdG9jaGFzdGljIG91dGNvbWUgJHgkIHRoYXQgbWF5IG9jY3VyIG9uY2Ugb3V0IG9mICRcZnJhY3sxfXtQKHgpfSQgdGltZXMuCkxldCdzIGNhbGwgdGhpcyBhbW91bnQgYXMgdGhlIGluZm9ybWF0aW9uIGNvbnRhaW5lZCBieSBvdXRjb21lICR4JC4KVGhlbiB0aGUgZW50cm9weSBpbiAkXGVxcmVme2VxOmVudHJvcHl9JCBlc3NlbnRpYWxseSBpcyBjYWxjdWxhdGluZyB0aGUgZXhwZWN0ZWQgbnVtYmVyIG9mIGJpdHMgcmVxdWlyZWQgdG8gZW5jb2RlIGFueSBvdXRjb21lIHBvc3NpYmxlIGZyb20gdGhlIGdpdmVuIHN0b2NoYXN0aWMgZXZlbnQuCk9yIGl0IGlzIHRoZSBleHBlY3RlZCBpbmZvcm1hdGlvbiBjb250YWluZWQgYnkgYSBnaXZlbiBzdG9jaGFzdGljIGV2ZW50LgoKT25lIGxhc3QgdGhpbmcgdG8gbm90ZSBpcyB0aGF0IHRoZSBudW1iZXIgb2YgYml0cyBoZXJlIGlzIGEgbWF0aGVtYXRpY2FsIGFydGlmZWN0IHRoYXQgY291bGQgbm90IGFsd2F5cyBiZSByZXByZXNlbnRlZCBieSBvdXIgZGlzY3JldGUgcmVhbCB3b3JsZC4KQ2VydGFpbmx5IHdlIGRvbid0IGhhdmUgbm9uLWludGVnZXIgYml0IGluIHJlYWwgd29ybGQgY29tcHV0aW5nIGJ1dCB0aGUgdmFsdWUgb2YgZW50cm9weSBpcyBhIHBvc2l0aXZlIHJlYWwgbnVtYmVyIG5vdCBsaW1pdGVkIHRvIGludGVnZXIuCgojIyMjIERpc3RyaWJ1dGlvbmFsIERpZmZlcmVuY2Ugey19CgpOb3cgbW92ZSBvbiB0byBjcm9zcyBlbnRyb3B5LgpDcm9zcyBlbnRyb3B5IGJldHdlZW4gdHdvIGRpc2NyZXRlIHByb2JhYmlsaXR5IGRpc3RyaWJ1dGlvbiAkcCQgYW5kICRxJCBvdmVyIHRoZSBzYW1lIHN1cHBvcnQgaXMgZGVmaW5lZCBhczoKCiQkClxiZWdpbntlcXVhdGlvbn0gXGxhYmVse2VxOmNyb3NzZW50cm9weX0KSChwLCBxKSA9IC0gXHN1bV9pIHBfaSBcbG9nXzJxX2kuClxlbmR7ZXF1YXRpb259CiQkCgpJbnR1aXRpdmVseSwKaXQgbWVhbnMgdGhhdCBpZiB3ZSBlbmNvZGUgYSBzdG9jaGFzdGljIGV2ZW50IHdpdGggYSBwcm9iYWJpbGl0eSBkaXN0cmlidXRpb24gTk9UIGxpbmtlZCB0byB0aGUgZXZlbnQsCmZvciBleGFtcGxlIGEgcHJlZGljdGVkIGRpc3RyaWJ1dGlvbiAkcSQgYmFzZWQgb24gYSBtb2RlbCwKd2hpbGUgdGhlIHRydWUgZGlzdHJpYnV0aW9uIGlzICRwJCwKd2hhdCB3aWxsIGJlIHRoZSBleHBlY3RlZCBudW1iZXIgb2YgYml0cyByZXF1aXJlZCB0byBlbmNvZGUgYWxsIHBvc3NpYmlsaXRpZXMgZnJvbSB0aGF0IGV2ZW50LgoKVG8gdW5kZXJzdGFuZCBjcm9zcyBlbnRyb3B5IG9uZSB1c2VmdWwgY29uY2VwdCBpcyB0aGUgW0t1bGxiYWNrLUxlaWJsZXIgZGl2ZXJnZW5jZV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvS3VsbGJhY2slRTIlODAlOTNMZWlibGVyX2RpdmVyZ2VuY2UpIGZyb20gJHEkIHRvICRwJDoKCiQkClxiZWdpbnthbGlnbmVkfQpLTChwIFx2ZXJ0XHZlcnQgcSkKJj0gSChwLCBxKSAtIEgocCkgXFwKJj0gXHN1bV9pcF9pXGxvZ18yXGZyYWN7cF9pfXtxX2l9LgpcZW5ke2FsaWduZWR9CiQkCgpNYXRoZW1hdGljYWxseSBpdCBpcyBqdXN0IHRoZSBzdW0gb2YgZGlmZmVyZW5jZSBvZiBsb2ctcHJvYmFiaWxpdHkgZnJvbSB0d28gZGlzdHJpYnV0aW9uICRwJCBhbmQgJHEkLAp3ZWlnaHRlZCBieSAkcCQuCkRpc3RyaWJ1dGlvbiAkcCQgaXMgdGhlIHJlZmVyZW5jZSBkaXN0cmlidXRpb24gYW5kICRxJCB0aGUgYXBwcm94aW1hdGlvbiBkaXN0cmlidXRpb24uCkl0IGlzIGEgbWVhc3VyZSBvZiBob3cgY2xvc2VseSB0aGUgZGlzdHJpYnV0aW9uICRxJCBpcyBhcHByb3hpbWF0aW5nICRwJC4KSWYgJHEkIGlzIHBlcmZlY3RseSBtaW1pY2tpbmcgJHAkLAp0aGUgS0wgZGl2ZXJnZW5jZSBpcyAwIGFuZCB0aGUgY3Jvc3MgZW50cm9weSBiZXR3ZWVuICRwJCBhbmQgJHEkIGlzIHRoZSBzYW1lIGFzIHRoZSBlbnRyb3B5IG9mICRwJDoKJEgocCwgcSkgPSBIKHApJC4KCkJhc2VkIG9uIHRoZSBhYm92ZSBmb3JtdWxhIHdlIGNhbiBhbHNvIGludGVycHJldCBLTCBkaXZlcmdlbmNlIGFzIHRoZSBleHRyYSBiaXRzIHJlcXVpcmVkIGR1ZSB0byBlbmNvZGluZyBhIHN0b2NoYXN0aWMgZXZlbnQgd2l0aCBhIHdyb25nIHByb2JhYmlsaXR5IGRpc3RyaWJ1dGlvbi4KCkZvciBvdXIgbG9naXN0aWMgcmVncmVzc2lvbiBtb2RlbCwKZGlzdHJpYnV0aW9uICRwJCBpcyB0aGUgZW1waXJpY2FsIGRpc3RyaWJ1dGlvbiAobGFiZWwgZGlzdHJpYnV0aW9uKSBhbmQgZGlzdHJpYnV0aW9uICRxJCBpcyBvdXIgbW9kZWwgcHJlZGljdGVkIGRpc3RyaWJ1dGlvbi4KRGVub3RlICRxX2kgPSBQKHlfaSA9IDEpJCBmb3IgdGhlIHByZWRpY3Rpb24gb2YgJGkkLXRoIGV4YW1wbGUuClRoZSBjcm9zcy1lbnRyb3B5LWxvc3Mgb2Ygb3VyIG1vZGVsIGhlbmNlIGNhbiBiZSB3cml0dGVuIGFzOgoKJCQKXG1ib3h7Q3Jvc3MtRW50cm9weSBMb3NzfSA9IC0gXGZyYWN7MX17Tn1cc3VtX2leTiBcYmlnZ1sgeV9pXGxvZ18ycV9pICsgKDEgLSB5X2kpXGxvZ18yKDEgLSBxX2kpXGJpZ2ddLAokJAoKd2hlcmUgJHlfaSBcaW4gXHswLDFcfSQgaXMgdGhlICRpJC10aCBiaW5hcnkgdHJhaW5pbmcgbGFiZWwgYW5kICRQKHlfaSA9IDEpJCB0aGUgbW9kZWwgcHJlZGljdGlvbiBmb3IgdGhlICRpJC10aCBleGFtcGxlIG91dCBvZiAkTiQgdG90YWwgdHJhaW5pbmcgZXhhbXBsZXMuClRoaXMgaXMgdGhlIG1lYW4gdmFsdWUgb2YgY3Jvc3MgZW50cm9weSBmb3IgZWFjaCB0cmFpbmluZyBleGFtcGxlLgpJdCBtZWFzdXJlcyBob3cgd2VsbCBvdXIgbW9kZWwgaXMgcHJlZGljdGluZyB0aGUgbGFiZWwgYmFzZWQgb24gdGhlIGRpc3RyaWJ1dGlvbmFsIGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgbGFiZWxzIGFuZCB0aGUgbW9kZWwgb3V0cHV0cy4KClNpbmNlICRxX2kgPSBQKHlfaSA9IDEpJCBpcyBleHByZXNzZWQgYnkgb3VyIG1vZGVsIGVxdWF0aW9uICRcZXFyZWZ7ZXE6bG9naXR9JCwKbm93IHdlIGNhbiBhcHBseSBncmFkaWVudCBkZXNjZW50IHRvIHRoZSBsb3NzIGZ1bmN0aW9uIHRvIGZpbmQgb3V0IHRoZSBvcHRpbXVtIG1vZGVsIHdlaWdodHMgdGhhdCBtaW5pbWl6ZSB0aGUgY3Jvc3MtZW50cm9weSBsb3NzLgoKIyMjIE1heGltdW0gTGlrZWxpaG9vZCBFc3RpbWF0b3IKCkJlZm9yZSB3ZSBpbXBsZW1lbnQgb3VyIG9wdGltaXplciBmb3IgYSBsb2dpc3RpYyByZWdyZXNzaW9uIG1vZGVsLAp3ZSBkZW1vbnN0cmF0ZSB0aGF0IG1pbmltaXppbmcgY3Jvc3MgZW50cm9weSBpcyBpbmRlZWQgZXF1aXZhbGVudCB0byBtYXhpbWl6aW5nIGRhdGEgbGlrZWxpaG9vZC4KClRoZSBkYXRhIGxpa2VsaWhvb2QgaXMganVzdCB0aGUgcHJvZHVjdCBvZiBhbGwgcHJlZGljdGVkIHByb2JhYmlsaXRpZXMgZm9yIGluZGl2aWR1YWwgZXhhbXBsZSwKcHJvdmlkZWQgdGhhdCB0aGV5IGFyZSBpbmRlcGVuZGVudC4KCiQkClxtYm94e2xpa2VsaWhvb2R9ID0gXHByb2RfaV5OIHFfaV57eV9pfSgxIC0gcV9pKV57MSAtIHlfaX0uCiQkCgpUaGUgbWF4aW11bSBsaWtlbGlob29kIGVzdGltYXRvciB3aWxsIHRyeSB0byBtYXhpbWl6ZSB0aGUgbG9nIG9mIHRoZSBsaWtlbGlob29kLAp3aGljaCBpczoKCiQkClxiZWdpbnthbGlnbmVkfQpcbWJveHtsb2ctbGlrfSAKJj0gXGxvZ18yIFxwcm9kX2leTiBxX2lee3lfaX0oMSAtIHFfaSleezEgLSB5X2l9IFxcCiY9IFxzdW1faV5OIFxsb2dfMiBxX2lee3lfaX0oMSAtIHFfaSleezEgLSB5X2l9IFxcCiY9IFxzdW1faV5OIFxiaWdnWyB5X2lcbG9nXzIgcV9pICsgKDEgLSB5X2kpXGxvZ18yKDEgLSBxX2kpIFxiaWdnXS4KXGVuZHthbGlnbmVkfQokJAoKQnkgdGFraW5nIHRoZSBhdmVyYWdlIGFzIHdlbGwsCnRoZSBuZWdhdGl2ZSBsb2ctbGlrZWxpaG9vZCBpcyBleGFjdGx5IHRoZSBjcm9zcyBlbnRyb3B5LgoKVGhvdWdoIHdlIGRpZG4ndCBkaXNjdXNzIHRoaXMgbGlua2FnZSBpbiBsaW5lYXIgcmVncmVzc2lvbiwKaWYgd2UgYXNzdW1lIHRoZSBlcnJvciB0ZXJtIGluIHRoZSBtb2RlbCBpcyBpbmRlcGVuZGVudGx5IGRpc3RyaWJ1dGVkIE5vcm1hbGx5LAp0aGUgT0xTIHNvbHV0aW9uIHRvIHRoZSBtb2RlbCB3ZWlnaHRzIChlcXVhdGlvbiAkXGVxcmVme2VxOm9sc30kKSBpcyBpbmRlZWQgYWxzbyB0aGUgTUxFIHNvbHV0aW9uLgoKIyMjIEdyYWRpZW50IERlc2NlbnQgd2l0aCBMb2cgTG9zcwoKTm93IGxldCdzIGFsc28gaW1wbGVtZW50IGEgYmF0Y2ggZ3JhZGllbnQgZGVzY2VudCBvcHRpbWl6ZXIgZm9yIGEgbG9naXN0aWMgcmVncmVzc2lvbiBtb2RlbC4KV2Ugd2lsbCB1c2UgdGhlIHNhbWUgdG95IGV4YW1wbGUgYW5kIGNyZWF0ZSBhZGRpdGlvbmFsIHJhbmRvbSBiaW5hcnkgbGFiZWxzIGZvciB0aGlzIGV4ZXJjaXNlLgoKYGBge3B5dGhvbiBsb2dpdF9mYWtlX2RhdGF9CnkyID0gbnAuYXJyYXkoW25wLnJhbmRvbS5iaW5vbWlhbCgxLCB2KSBmb3IgdiBpbiBzaWdtb2lkKFguZG90KGJldGEpKV0pCmBgYAoKVGhlIGdyYWRpZW50IGZ1bmN0aW9uIG11c3QgYmUgZGVyaXZlZCB3aXRoIHJlc3BlY3QgdG8gbW9kZWwgd2VpZ2h0cy4KVG8gc2ltcGxpZnkgdGhlIG1hdGggd2UgcmVwbGFjZSBsb2cgb2YgYmFzZSAyIHdpdGggbmF0dXJhbCBsb2cgKHdpdGggbm8gaW1wYWN0IG9uIHRoZSBvcHRpbWl6YXRpb24pLAphbmQgd2UgdGFrZSBhZHZhbnRhZ2Ugb2YgdGhlIGZhY3QgdGhhdCB0aGUgZGVyaXZhdGl2ZSBvZiB0aGUgc2lnbW9pZCBmdW5jdGlvbiBpczpeW0hlcmUgd2UgdXNlIHRoZSBjb21tb24gZGVyaXZhdGl2ZXM6ICRcZnJhY3tkZih4KV5ufXtkeH0gPSBuZih4KV57bi0xfWYnKHgpJCBhbmQgJFxmcmFje2RlXntmKHgpfX17ZHh9ID0gZicoeCllXntmKHgpfS4kXQoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje2RzKHQpfXtkdH0KJj0gXGZyYWN7ZFxmcmFjezF9ezEgKyBlXnstdH19fXtkdH0gXFwKJj0gLSgxICsgZV57LXR9KV57LTJ9IFxjZG90ICgtIGVeey10fSkgXFwKJj0gXGZyYWN7ZV57LXR9fXsoMSArIGVeey10fSleMn0gXFwKJj0gXGZyYWN7MX17MSArIGVeey10fX0gXGNkb3QgXGZyYWN7ZV57LXR9fXsxICsgZV57LXR9fSBcXAomPSBzKHQpIFxjZG90IFsxIC0gcyh0KV0uClxlbmR7YWxpZ25lZH0KJCQKClRoZSBncmFkaWVudCBpbiBvdXIgdW5pdmFyaWF0ZSBtb2RlbCB3LnIudC4gdGhlIGJpYXMgdGVybSB3aWxsIGJlOl5bSGVyZSB3ZSB1c2UgdGhlIGNvbW1vbiBkZXJpdmF0aXZlICRcZnJhY3tkXGxuIGYoeCl9e2R4fSA9IFxmcmFje2YnKHgpfXtmKHgpfSQgYW5kIHRoZSBbY2hhaW4gcnVsZV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvQ2hhaW5fcnVsZSkgdG8gaGFuZGxlIHRoZSB0ZXJtICRcZnJhY3tccGFydGlhbFxsbiBxX2l9e1xwYXJ0aWFsXGJldGFfMH0kIHdoZXJlICRxX2kkIGlzIHRoZSBzaWdtb2lkIGNvbXB1dGVkIGZvciB0aGUgJGkkLXRoIGV4YW1wbGUuXQoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje1xwYXJ0aWFsXG1ib3h7TG9nTG9zc319e1xwYXJ0aWFsXGJldGFfMH0gCiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgXGJpZ2dbIHlfaVxmcmFje1xwYXJ0aWFsXGxuIHFfaX17XHBhcnRpYWxcYmV0YV8wfSArIAogICgxIC0geV9pKVxmcmFje1xwYXJ0aWFsXGxuKDEgLSBxX2kpfXtccGFydGlhbFxiZXRhXzB9XGJpZ2ddIFxcCiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgXGJpZ2dbIHlfaVxmcmFjezF9e3FfaX1cZnJhY3tccGFydGlhbCBxX2l9e1xwYXJ0aWFsXGJldGFfMH0gKyAKICAoMSAtIHlfaSlcZnJhY3sxfXsxIC0gcV9pfVxmcmFje1xwYXJ0aWFsKDEgLSBxX2kpfXtccGFydGlhbFxiZXRhXzB9XGJpZ2ddIFxcCiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgXGJpZ2dbIHlfaVxmcmFjezF9e3FfaX1cZnJhY3tccGFydGlhbCAoXGJldGFfMCArIFxiZXRhXzF4X2kpfXtccGFydGlhbFxiZXRhXzB9XGZyYWN7XHBhcnRpYWwgcV9pKHQpfXtccGFydGlhbCB0fSAtIAogICgxIC0geV9pKVxmcmFjezF9ezEgLSBxX2l9XGZyYWN7XHBhcnRpYWwgKFxiZXRhXzAgKyBcYmV0YV8xeF9pKX17XHBhcnRpYWxcYmV0YV8wfVxmcmFje1xwYXJ0aWFsIHFfaSh0KX17XHBhcnRpYWwgdH1cYmlnZ10gXFwKJj0gLSBcZnJhY3sxfXtOfVxzdW1faSBcYmlnZ1sgeV9pXGZyYWN7MX17cV9pfXFfaSgxIC0gcV9pKSAtIAogICgxIC0geV9pKVxmcmFjezF9ezEgLSBxX2l9cV9pKDEgLSBxX2kpXGJpZ2ddIFxcCiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgXGJpZ2dbIHlfaSgxIC0gcV9pKSAtICgxIC0geV9pKXFfaSBcYmlnZ10gXFwKJj0gLSBcZnJhY3sxfXtOfVxzdW1faSAoeV9pIC0gcV9pKS4KXGVuZHthbGlnbmVkfQokJAoKU2ltaWxhcnkgZm9yIHRoZSB3ZWlnaHQ6CgokJApcZnJhY3tccGFydGlhbFxtYm94e0xvZ0xvc3N9fXtccGFydGlhbFxiZXRhXzF9Cj0gLSBcZnJhY3sxfXtOfVxzdW1faSAoeV9pIC0gcV9pKXhfaS4KJCQKCk5vdyB0aGUgUHl0aG9uIGNvZGUgZm9yIGJhdGNoIGdyYWRpZW50IGRlc2NlbnQgd2l0aCBsb2ctbG9zczoKCmBgYHtweXRob24gbG9naXRfZ2R9CmRlZiBsb2dsb3NzKFgsIHksIGIpOgogIGxvZ2xvc3NfcG9zID0geSAqIG5wLmxvZyhzaWdtb2lkKFguZG90KGIpKSkKICBsb2dsb3NzX25lZyA9ICgxIC0geSkgKiBucC5sb2coMSAtIHNpZ21vaWQoWC5kb3QoYikpKQogIHJldHVybiAtIChsb2dsb3NzX3BvcyArIGxvZ2xvc3NfbmVnKS5tZWFuKCkKCmRlZiBsb2dpdF9ncmFkX2Z1bmMoWCwgeSwgYik6CiAgcmV0dXJuIC0gKHkgLSBzaWdtb2lkKFguZG90KGIpKSkuZG90KFgpIC8gWC5zaGFwZVswXQoKZGVmIGNyb3NzX2VudHJvcHlfZ2Rfb3B0aW1pemUoWCwgeSwgbHI9LjAxLCBuX2Vwb2NoPTEwLCBiYXRjaF9zaXplPTY0KToKICBiID0gbnAucmFuZG9tLm5vcm1hbChzaXplPVguc2hhcGVbMV0pCiAgbCA9IFtsb2dsb3NzKFgsIHksIGIpXQogIGZvciBlcG9jaCBpbiByYW5nZShuX2Vwb2NoKToKICAgICMgU2h1ZmZsZSB0aGUgZGF0YXNldCBiZWZvcmUgZWFjaCBlcG9jaC4KICAgIHNpZCA9IG5wLnJhbmRvbS5wZXJtdXRhdGlvbihYLnNoYXBlWzBdKQogICAgWHMgPSBYW3NpZCw6XQogICAgeXMgPSB5W3NpZF0KICAgIGkgPSAwCiAgICBuX3N0ZXAgPSBpbnQobnAuY2VpbChYLnNoYXBlWzBdIC8gYmF0Y2hfc2l6ZSkpCiAgICBmb3Igc3RlcCBpbiByYW5nZShuX3N0ZXApOgogICAgICBYYiA9IFhzW2k6aStiYXRjaF9zaXplLDpdCiAgICAgIHliID0geXNbaTppK2JhdGNoX3NpemVdCiAgICAgIGIgLT0gbHIqbG9naXRfZ3JhZF9mdW5jKFhiLCB5YiwgYikKICAgICAgbC5hcHBlbmQobG9nbG9zcyhYYiwgeWIsIGIpKQogICAgICBpICs9IGJhdGNoX3NpemUKICByZXR1cm4gYiwgbAoKbG9nX2JldGEsIGxvZ19sb3NzID0gY3Jvc3NfZW50cm9weV9nZF9vcHRpbWl6ZShYLCB5MiwgbHI9LjAxLCBuX2Vwb2NoPTEwMCkKcHJpbnQobG9nX2JldGEpCmBgYAoKYGBge3B5dGhvbiBsb2dpdF9sb3NzX3Bsb3R9Cm9maWxlID0gInBsb3RzL3RveV9sb2dfbG9zcy5odG1sIgpwZGF0YSA9IFtnby5TY2F0dGVyKHg9bnAuYXJhbmdlKGxlbihsb2dfbG9zcykpLCB5PWxvZ19sb3NzKV0KcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPXBkYXRhLAogIGxheW91dD1nby5MYXlvdXQoCiAgICB0aXRsZT0iVHJhY2Ugb2YgVHJhaW5pbmcgTG9nLUxvc3MiLAogICAgeGF4aXM9ZGljdCh0aXRsZT0iU3RlcCIpLAogICAgeWF4aXM9ZGljdCh0aXRsZT0iTG9zcyIpKSkKYGBgCgpgYGB7ciwgZWNobz1GQUxTRX0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpDb21wYXJpbmcgdG8gbGluZWFyIHJlZ3Jlc3Npb24sCmEgbG9naXN0aWMgcmVncmVzc2lvbiBtb2RlbCBpcyBoYXJkZXIgdG8gY29udmVyZ2UuClNpbmNlIG91ciBuYWl2ZSBpbXBsZW1lbnRhdGlvbiBkb2VzIG5vdCBkbyBjb252ZXJnZW5jZSBkaWFnbm9zdGljcywKbGV0J3MgdXNlIFIncyBidWlsdC1pbiBgZ2xtYCBmdW5jdGlvbiB3aGljaCB1c2UgTmV3dG9uJ3MgbWV0aG9kIChhIDJuZC1vcmRlciBvcHRpbWl6ZXIgdXRpbGl6aW5nIG5vdCBvbmx5IDFzdC1vcmRlciBidXQgYWxzbyAybmQtb3JkZXIgZGVyaXZhdGl2ZXMpIHRvIGNoZWNrIHRoZSBlc3RpbWF0aW9uIHJlc3VsdCBvZiBvdXIgdG95IGV4YW1wbGU6CgpgYGB7ciBsb2dpdF9jaGVja19zb2x1dGlvbn0KIyBUaGlzIGlzIFIgY29kZS4KY29lZihnbG0oeSB+IHgsIGRhdGE9ZGF0YS5mcmFtZSh5PXB5JHkyLCB4PXB5JFhbLDJdKSwgZmFtaWx5PWJpbm9taWFsKSkKYGBgCgpOb3cgaW5jcmVhc2UgYm90aCB0aGUgbGVhcm5pbmcgcmF0ZSBhbmQgdHJhaW5pbmcgZXBvY2hzIG9mIG91ciBuYWl2ZSBncmFkaWVudCBkZXNjZW50IG9wdGltaXplcjoKCmBgYHtweXRob24gbG9naXRfZ2RfbW9yZX0KcHJpbnQoY3Jvc3NfZW50cm9weV9nZF9vcHRpbWl6ZShYLCB5MiwgbHI9MSwgbl9lcG9jaD0yMDApWzBdKQpgYGAKClNlZW1zIGJldHRlci4KCk9yIHdlIGNhbiB1c2UgdGhlIFB5dGhvbiBwYWNrYWdlIGBzdGF0c21vZGVsc2AgKHdoaWNoIGFsc28gdXNlcyBhIDJuZC1vcmRlciBvcHRpbWl6ZXIgYnkgZGVmYXVsdCkgdG8gY2hlY2sgb3VyIHJlc3VsdDogCgpgYGB7cHl0aG9uIGxvZ2l0X3N0YXRzbW9kZWxzfQppbXBvcnQgc3RhdHNtb2RlbHMuYXBpIGFzIHNtCnNtLkxvZ2l0KHkyLCBYKS5maXQoKS5zdW1tYXJ5KCkKYGBgCgpPciB0aGUgYHNrbGVhcm5gIHJlc3VsdDoKCmBgYHtweXRob24gbG9naXRfc2tsZWFybn0KZnJvbSBza2xlYXJuLmxpbmVhcl9tb2RlbCBpbXBvcnQgTG9naXN0aWNSZWdyZXNzaW9uCiMgV2UgbmVlZCB0byBzZXQgcGFyYW0gQyB0byBhbiBhcmJpdHJhcmlseSBsYXJnZSBudW1iZXIgdG8gc3VwcHJlc3MgcmVndWxhcml6YXRpb24KIyBzaW5jZSBvdXIgbmFpdmUgYXBwcm9hY2ggZG9lc24ndCBpbXBsZW1lbnQgYW55IHJlZ3VsYXJpemF0aW9uLgojIFdlIHNldCBmaXRfaW50ZXJjZXB0PUZhbHNlIHNpbmNlIG91ciBkZXNpZ24gbWF0cml4IGFscmVhZHkgY29udGFpbnMgaW50ZXJjZXB0LgpwcmludChMb2dpc3RpY1JlZ3Jlc3Npb24oQz0xZTE2LCBmaXRfaW50ZXJjZXB0PUZhbHNlLCBzb2x2ZXI9ImxpYmxpbmVhciIpLmZpdChYLCB5MikuY29lZl8pCmBgYAoKIyBBdXRvbWF0aWMgRGlmZmVyZW50aWF0aW9uCgpJbiB0aGUgcHJldmlvdXMgc2VjdGlvbiB3ZSBpbXBsZW1lbnQgYSBzaW1wbGUgZ3JhZGllbnQgZGVzY2VudCBvcHRpbWl6ZXIgYnkgbWFudWFsbHkgZGVyaXZlIHRoZSBmdW5jdGlvbmFsIGZvcm0gb2YgZ3JhZGllbnQgb24gb3VyIG93bi4KVGhpcyBjb3VsZCBiZSB0cm91Ymxlc29tZSBpZiBvdXIgbW9kZWwgYmVjb21lcyBtb3JlIGFuZCBtb3JlIGNvbXBsaWNhdGVkLAphcyBpbiB0aGUgY2FzZSBvZiBhIGRlZXAgbmV1cmFsIG5ldC4KCkF1dG9tYXRjaSBkaWZmZXJlbnRpYXRpb24gaXMgYSBwcm9ncmFtbWluZyB0ZWNobmlxdWUgdG8gY2FsY3VsYXRlIHRoZSBncmFkaWVudCBvZiBhbnkgZ2l2ZW4gZnVuY3Rpb24uCk9uZSBvZiB0aGUgbW9zdCBwb3B1bGFyIGxpYnJhcnkgZm9yIHRoaXMgcHVycG9zZSBpcyBbVGVuc29yRmxvd10oaHR0cHM6Ly9naXRodWIuY29tL3RlbnNvcmZsb3cvdGVuc29yZmxvdykuCgpMZXQncyB1c2UgYHRlbnNvcmZsb3dgIHRvIGltcGxlbWVudCBvdXIgc2ltcGxlIGdyYWRpZW50IGRlc2NlbnQgb3B0aW1pemVyIGFnYWluLgpCdXQgdGhpcyB0aW1lIHdlIHdpbGwgTk9UIGV4cGxpY2l0bHkgZGVyaXZlIHRoZSBncmFkaWVudCBmdW5jdGlvbi4KSW5zdGVhZCwKd2Ugd2lsbCBvbmx5IHNwZWNpZnkgdGhlIHRhcmdldCBmdW5jdGlvbiB3aGljaCBpcyBqdXN0IHRoZSBsb3NzIGZ1bmN0aW9uIG9mIG91ciBtb2RlbC4KCmBgYHtweXRob24gdGZfYWR9CmltcG9ydCB0ZW5zb3JmbG93IGFzIHRmCnRmLmVuYWJsZV9lYWdlcl9leGVjdXRpb24oKQoKIyBVc2UgdGVuc29yIHRvIHJlcHJlc2VudCBvdXIgZGF0YS4KIyBOb3RlIHRoYXQgd2UgbmVlZCB0byBiZSB2ZXJ5IHNwZWNpZmljIGFib3V0IGR0eXBlL3NoYXBlIG9mIG91ciB0ZW5zb3JzLgpYX3RmID0gdGYuY29udmVydF90b190ZW5zb3IoWCwgZHR5cGU9dGYuZmxvYXQzMikKYmV0YV90ZiA9IHRmLnJlc2hhcGUodGYuY29udmVydF90b190ZW5zb3IoYmV0YSwgZHR5cGU9dGYuZmxvYXQzMiksICgyLDEpKQplX3RmID0gdGYucmVzaGFwZSh0Zi5jb252ZXJ0X3RvX3RlbnNvcihlLCBkdHlwZT10Zi5mbG9hdDMyKSwgKE4sIDEpKQp5X3RmID0gdGYubWF0bXVsKFhfdGYsIGJldGFfdGYpICsgZV90Zgp5Ml90ZiA9IHRmLnJlc2hhcGUodGYuY29udmVydF90b190ZW5zb3IoeTIsIGR0eXBlPXRmLmZsb2F0MzIpLCAoTiwgMSkpCgpkZWYgbG9zc19tc2VfdGYoWCwgeSwgYmV0YSk6CiAgeV9oYXQgPSB0Zi5tYXRtdWwoWCwgYmV0YSkKICByZXR1cm4gdGYucmVkdWNlX21lYW4oaW5wdXRfdGVuc29yID0gKHlfaGF0IC0geSkqKjIpCgpkZWYgbG9nbG9zc190Zl9iYWQoWCwgeSwgYmV0YSk6CiAgIyBUaGlzIGNhbiBzdWZmZXIgZnJvbSBudW1lcmljYWwgc3RhYmlsaXR5IGlzc3VlLgogIGxvZ2xvc3NfcG9zID0geSAqIHRmLmxvZyh0Zi5zaWdtb2lkKHRmLm1hdG11bChYLCBiZXRhKSkpCiAgbG9nbG9zc19uZWcgPSAoMSAtIHkpICogdGYubG9nKDEgLSB0Zi5zaWdtb2lkKHRmLm1hdG11bChYLCBiZXRhKSkpCiAgcmV0dXJuIC0gdGYucmVkdWNlX21lYW4obG9nbG9zc19wb3MgKyBsb2dsb3NzX25lZykKCmRlZiBsb2dsb3NzX3RmKFgsIHksIGJldGEpOgogICMgdGYuc2lnbW9pZCBpcyBub3QgbnVtZXJpY2FsbHkgc3RhYmxlLgogICMgQnV0IHRoZXJlIGlzIGEgY29udmVuaWVudCBmdW5jdGlvbiB0byBkbyB0aGUgY3Jvc3MgZW50cm9weSBjYWxjdWxhdGlvbiBzdGFibHkuCiAgcyA9IHRmLm5uLnNpZ21vaWRfY3Jvc3NfZW50cm9weV93aXRoX2xvZ2l0cyhsYWJlbHM9eSwgbG9naXRzPXRmLm1hdG11bChYLCBiZXRhKSkKICByZXR1cm4gdGYucmVkdWNlX21lYW4ocykKCmRlZiBnZF9vcHRpbWl6ZV90ZihYLCB5LCBsb3NzX2Z1bmMsIGxyPS4wMSwgbl9zdGVwPTEwMCk6CiAgZ3JhZF9mdW5jX3RmID0gdGYuY29udHJpYi5lYWdlci5ncmFkaWVudHNfZnVuY3Rpb24obG9zc19mdW5jLCBwYXJhbXM9WzJdKQogIGJldGEgPSB0Zi5yYW5kb21fbm9ybWFsKCgyLCAxKSkKICBmb3Igc3RlcCBpbiByYW5nZShuX3N0ZXApOgogICAgZ3JhZCA9IGdyYWRfZnVuY190ZihYLCB5LCBiZXRhKVswXQogICAgYmV0YSAtPSBsciAqIGdyYWQKICByZXR1cm4gYmV0YS5udW1weSgpCgojIEZvciB0aGUgTVNFIGxvc3MgcHJvYmxlbS4KcHJpbnQoZ2Rfb3B0aW1pemVfdGYoWF90ZiwgeV90ZiwgbG9zc19mdW5jPWxvc3NfbXNlX3RmLCBuX3N0ZXA9MzAwMCkpCgojIEZvciB0aGUgY3Jvc3MgZW50cm9weSBsb3NzIHByb2JsZW0uCnByaW50KGdkX29wdGltaXplX3RmKFhfdGYsIHkyX3RmLCBsb3NzX2Z1bmM9bG9nbG9zc190ZiwgbHI9LjUsIG5fc3RlcD01MDAwKSkKYGBgCgpJbiB0aGUgYWJvdmUgY29kaW5nIGV4YW1wbGUgb25lIHNob3VsZCByZWFsaXplIHRoYXQgd2Ugbm8gbG9uZ2VyIG5lZWQgdG8gaGFyZGNvZGUgdGhlIGZ1bmN0aW9uYWwgZm9ybSBvZiB0aGUgZ3JhZGllbnRzLgpJbnN0ZWFkIHdlIGp1c3QgcGx1Zy1pbiB0aGUgbG9zcyBmdW5jdGlvbiBhbmQgbGV0IGB0ZW5zb3JmbG93YCB0byBkbyB0aGUgZ3JhZGllbnQgY2FsY3VsYXRpb24gZm9yIHVzLgoKT2YgY291cnNlIGluIGFjdHVhbCBkZXZlbG9wbWVudCB3ZSB3aWxsIHVzZSBoaWdoZXItbGV2ZWwgQVBJcyB0byBpbXBsZW1lbnQgb3VyIG1vZGVsLAp3aGVyZSB0aGUgZW50aXJlIG9wdGltaXphdGlvbiBwcm9jZXNzIGlzIGFic3RyYWN0ZWQgYXdheSBmcm9tIHRoZSBhcHBsaWNhdGlvbiBjb2RlLgoKIyBOZXVyYWwgTmV0d29ya3MKCkJvdGggbGluZWFyIHJlZ3Jlc3Npb24gYW5kIGxvZ2lzdGljIHJlZ3Jlc3Npb24gY2FuIGJlIGNvbnNpZGVyZWQgYXMgc2ltcGxlIGFkZGl0aXZlIG1vZGVsIG9mIHRoZSBmb3JtOgoKJCQKXGhhdHt5fSA9IFxQaGlcYmlnZyhcc3VtX3tpPTF9XlB3X2l4X2lcYmlnZyksCiQkCgp3aGVyZSAkUCQgaXMgdGhlIG51bWJlciBvZiBmZWF0dXJlcyB1c2VkLAokeF9pJCBpcyB0aGUgJGkkLXRoIGZlYXR1cmUsCmFuZCAkXFBoaShcY2RvdCkkIGlzIGEgZnVuY3Rpb24gYXBwbGllZCB0byB0aGUgb3V0cHV0LgpJbiBsaW5lYXIgcmVncmVzc2lvbiAkXFBoaShcY2RvdCkkIGlzIHNpbXBseSBhbiBpZGVudGl0eSBmdW5jdGlvbi4KSW4gbG9naXN0aWMgcmVncmVzc2lvbiAkXFBoaShcY2RvdCkkIGlzIHRoZSBzdGFuZGFyZCBzaWdtb2lkIGZ1bmN0aW9uLgoKTm93IGNvbnNpZGVyIHRoZXJlIGlzIGEgd2F5IHRvIGVuc2VtYmxlIG11bHRpcGxlIHN1Y2ggYWRkaXRpdmUgbW9kZWxzIHRvZ2V0aGVyIHRvIGdlbmVyYXRlIGEgcG90ZW50aWFsbHkgYmV0dGVyIGFuZCBtb3JlIHNvcGhpc3RpY2F0ZWQgbW9kZWwuCldlIHVzZSB0aGUgZm9sbG93aW5nIGRpYWdyYW0gZm9yIGlsbHVzdHJhdGlvbi4KCmBgYHtyIG5uX2RpYWdyYW0sIGVjaG89RkFMU0V9CiMgRHJhdyBhIHNpbXBsZSBuZXVyYWwgbmV0cy4KRGlhZ3JhbW1lUjo6Z3JWaXooIgpkaWdyYXBoIHN1YnNjcmlwdCB7CgogIGdyYXBoIFtsYXlvdXQgPSBkb3QgcmFua2RpciA9IExSIG9yZGVyaW5nID0gaW4gcmFua3NlcD0yIHNwbGluZXM9dHJ1ZV0KCiAgbm9kZSBbc2hhcGUgPSBjaXJjbGVdCgogIHN1YmdyYXBoIGNsdXN0ZXJfaW5wdXRfbGF5ZXIgewogICAgbGFiZWwgPSAnSW5wdXQgTGF5ZXInCiAgICB4MSBbbGFiZWwgPSAneEBfezF9J10KICAgIHgyIFtsYWJlbCA9ICd4QF97Mn0nXQogICAgeDMgW2xhYmVsID0gJ3hAX3szfSddCiAgfQoKICBzdWJncmFwaCBjbHVzdGVyX2hpZGRlbl9sYXllciB7CiAgICBsYWJlbCA9ICdIaWRkZW4gTGF5ZXInCiAgICBuMTEgW2xhYmVsID0gJ3lAX3sxMX0nIGNvbG9yID0gYmx1ZSBmb250Y29sb3IgPSBibHVlXQogICAgbjEyIFtsYWJlbCA9ICd5QF97MTJ9JyBjb2xvciA9IGRhcmtncmVlbiBmb250Y29sb3IgPSBkYXJrZ3JlZW5dCiAgfQoKICBzdWJncmFwaCBjbHVzdGVyX291dHB1dF9sYXllciB7CiAgICBsYWJlbCA9ICdPdXRwdXQgTGF5ZXInCiAgICBuMjEgW2xhYmVsID0gJ3lAX3syfSddCiAgfQoKICBlZGdlIFthcnJvd3NpemUgPSAuMjVdCgogIHgxIC0+IG4xMSBbbGFiZWwgPSAnd0BfezExMX0nIGNvbG9yID0gYmx1ZSBmb250Y29sb3IgPSBibHVlXQogIHgxIC0+IG4xMiBbbGFiZWwgPSAnd0BfezExMn0nIGNvbG9yID0gZGFya2dyZWVuIGZvbnRjb2xvciA9IGRhcmtncmVlbl0KCiAgeDIgLT4gbjExIFtsYWJlbCA9ICd3QF97MjExfScgY29sb3IgPSBibHVlIGZvbnRjb2xvciA9IGJsdWVdCiAgeDIgLT4gbjEyIFtsYWJlbCA9ICd3QF97MjEyfScgY29sb3IgPSBkYXJrZ3JlZW4gZm9udGNvbG9yID0gZGFya2dyZWVuXQoKICB4MyAtPiBuMTEgW2xhYmVsID0gJ3dAX3szMTF9JyBjb2xvciA9IGJsdWUgZm9udGNvbG9yID0gYmx1ZV0KICB4MyAtPiBuMTIgW2xhYmVsID0gJ3dAX3szMTJ9JyBjb2xvciA9IGRhcmtncmVlbiBmb250Y29sb3IgPSBkYXJrZ3JlZW5dCgogIG4xMSAtPiBuMjEgW2xhYmVsID0gJ3dAX3sxMTIxfSddCiAgbjEyIC0+IG4yMSBbbGFiZWwgPSAnd0BfezEyMjF9J10KCn0iKQpgYGAKCkluIHRoZSBhYm92ZSBkaWFncmFtLAokWV97MTF9JCBpcyBhIHNpbmdsZSBhZGRpdGl2ZSBtb2RlbAoKJCQKWV97MTF9ID0gXFBoaShXX3sxMTF9WF8xICsgV197MjExfVhfMiArIFdfezMxMX1YXzMpLgokJAoKU2ltaWxhcmx5ICRZX3sxMn0kIGlzIGFub3RoZXIgc3VjaCBtb2RlbCAod2l0aCB0aGUgc2FtZSBpbnB1dCBmZWF0dXJlIHNldCBidXQgZGlmZmVyZW50IG1vZGVsIHdlaWdodHMpCgokJApZX3sxMn0gPSBcUGhpKFdfezExMn1YXzEgKyBXX3syMTJ9WF8yICsgV197MzEyfVhfMykuCiQkCgpNb2RlbCAkWV8yJCBpcyB5ZXQgYW5vdGhlciBhZGRpdGl2ZSBtb2RlbCBidXQgdGFrZXMgdGhlIG91dHB1dCBvZiB0aGUgYWJvdmUgdHdvIG1vZGVsczoKCiQkCllfMiA9IFxQaGkoV197MTEyMX1ZX3sxMX0gKyBXX3sxMjIxfVlfezEyfSkuCiQkCgpUaGUgYWJvdmUgc2V0dXAgaXMgYSBzaW1wbGUgYXJjaGl0ZWN0dXJlIG9mIGEgbmV1cmFsIG5ldHdvcmsgbW9kZWwsCndpdGggb25seSBvbmUgaGlkZGVuIGxheWVyIG9mIHR3byAqbmV1cm9ucyouCihXZSBhbHNvIGlnbm9yZSB0aGUgY29uc3RhbnQvYmlhcyB0ZXJtIGluIGVhY2ggbGF5ZXIgZm9yIHNpbXBsaWNpdHkuKQpBIG5ldXJvbiBpcyBzaW1wbHkgYW4gYWRkaXRpdmUgbW9kZWwgd2l0aCBhIHNvLWNhbGxlZCBhY3RpdmF0aW9uIGZ1bmN0aW9uICRcUGhpKFxjZG90KSQgdG8gdHJhbnNmb3JtIHRoZSBvdXRwdXQgZnJvbSBhbnkgcmVhbCBudW1iZXIgaW50byBhIHNjYWxlZCBzaWduYWwuCgpPbmUgbm93IGNhbiBlYXNpbHkgcmVhbGl6ZSB0aGF0IGEgbG9naXN0aWMgcmVncmVzc2lvbiBtb2RlbCBjb3VsZCBiZSB2aWV3ZWQgYXMgYSBkZWdlbmVyYXRlZCBuZXVyYWwgbmV0d29yayBtb2RlbCB3aXRoIHNpbmdsZSBuZXVyb24gYW5kIHVzaW5nIHNpZ21vaWQgYXMgdGhlIGFjdGl2YXRpb24gZnVuY3Rpb24uCkFuZCBhIGxpbmVhciByZWdyZXNzaW9uIG1vZGVsIGlzIGEgZGVnZW5lcmF0ZWQgbmV1cmFsIG5ldHdvcmsgbW9kZWwgd2l0aCBzaW5nbGUgbmV1cm9uIGFuZCB3aXRob3V0IGFuIGFjdGl2YXRpb24gZnVuY3Rpb24uCgojIyBBY3RpdmF0aW9uIEZ1bmN0aW9uCgpXaHkgZG8gd2UgbmVlZCB0aGUgYWN0aXZhdGlvbiBmdW5jdGlvbj8KSW4gdGhlIGFib3ZlIG5ldXJhbCBuZXR3b3JrIG1vZGVsIGluIHRoZSBhYnNlbmNlIG9mIGFjdGl2YXRpb24gZnVuY3Rpb24gdGhlIGZpbmFsIG91dHB1dCBtb2RlbCAkWV8yJCB3aWxsIGRlZ2VuZXJhdGUgaW50byBhIHNpbXBsZSBsaW5lYXIgbW9kZWwuCldlIGNhbiB1c2Ugc2ltcGxlciBub3RhdGlvbnMgdG8gZGVtb25zdHJhdGUgdGhpczoKCiQkClxiZWdpbnthbGlnbmVkfQp5XzEgJj0gYXggKyBiLCBcXAp5XzIgJj0gY3ggKyBkLCBcXAp5XzMgJj0gZSArIGZ5XzEgKyBneV8yIFxcCiY9IGUgKyBmKGF4ICsgYikgKyBnKGN4ICsgZCkgXFwKJj0gXHVuZGVyYnJhY2V7KGUgKyBmYiArIGdkKX1fXHRleHR7Qmlhc30gKyBcdW5kZXJicmFjZXsoZmEgKyBnYyl9X1x0ZXh0e1dlaWdodH14LgpcZW5ke2FsaWduZWR9CiQkCgpXaXRob3V0IGFjdGl2YXRpb24gZnVuY3Rpb24sCm5vIG1hdHRlciBob3cgbWFueSBuZXVyb25zIG9yIGxheWVycyB3ZSBkZXNpZ24gZm9yIG91ciBtb2RlbCwKaXQgZXZlbnR1YWxseSByZWR1Y2VzIHRvIGEgc2ltcGxlIGxpbmVhciBtb2RlbC4KV2l0aCB0aGUgYWN0aXZhdGlvbiBmdW5jdGlvbiBhcHBsaWVkIHRvIGVhY2ggbmV1cm9uLAp0aGUgbW9kZWwgYmVjb21lcyAqbm9uLWxpbmVhciogYW5kIGhlbmNlIGNhbiBoYW5kbGUgbXVjaCBtb3JlIGNvbXBsaWNhdGVkIHBhdHRlcm5zIGhpZGRlbiBiZWhpbmQgdGhlIGRhdGEuCgpTb21lIHBvcHVsYXIgYWN0aXZhdGlvbiBmdW5jdGlvbnM6CgorIFtTaWdtb2lkIChMb2dpc3RpYyldKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0xvZ2lzdGljX2Z1bmN0aW9uKQorIFtUYW5oIChIeXBlcmJvbGljIFRhbmdlbnQpXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9IeXBlcmJvbGljX2Z1bmN0aW9uI0h5cGVyYm9saWNfdGFuZ2VudCkKKyBbUmVMVSAoUmVjdGlmaWVkIExpbmVhciBVbml0KV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvUmVjdGlmaWVyXyhuZXVyYWxfbmV0d29ya3MpKQorIFN3aXNoOiAkZih4KSA9IHggXGNkb3QgXG1ib3h7c2lnbW9pZH0oeCkkLCBwcm9wb3NlZCBieSBbR29vZ2xlIEJyYWluXShodHRwczovL2FpLmdvb2dsZS9yZXNlYXJjaC90ZWFtcy9icmFpbi8pCgojIyBCYWNrcHJvcGFnYXRpb24KClRvIHNvbHZlIGZvciBtb2RlbCB3ZWlnaHRzIGluIGEgbmV1cmFsIG5ldHdvcmssCndlIHVzZSBhIHRlY2huaXF1ZSBjYWxsZWQgYmFja3Byb3BhZ2F0aW9uIHdoaWNoIGlzIGVzc2VudGlhbGx5IGFuIGl0ZXJhdGl2ZSBwcm9jZXNzIG9mIGdyYWRpZW50IGRlc2NlbnQuCgpUbyBzaW1wbGlmeSBub3RhdGlvbiB3ZSBhc3N1bWUgZWFjaCBuZXVyb24gaXMgc2ltcGx5IGEgdW5pdmFyaWF0ZSBtb2RlbC4KQ29uc2lkZXIgdGhlIGZvbGxvd2luZyBtaW5pbXVtIGFyY2hpdGVjdHVyZToKCmBgYHtyIHNpbXBsaWZpZWRfbm5fZGlhZ3JhbSwgZWNobz1GQUxTRX0KRGlhZ3JhbW1lUjo6Z3JWaXooIgpkaWdyYXBoIHN1YnNjcmlwdCB7CgogIGdyYXBoIFtsYXlvdXQgPSBkb3QgcmFua2RpciA9IExSIG9yZGVyaW5nID0gaW4gcmFua3NlcD0yXQoKICBub2RlIFtzaGFwZSA9IGNpcmNsZV0KCiAgeDAgW2xhYmVsID0gJzEnXQogIHgxIFtsYWJlbCA9ICd4J10KICB6MCBbbGFiZWwgPSAnMSddCiAgejEgW2xhYmVsID0gJ3onXQogIHkgIFtsYWJlbCA9ICd5J10KCiAgZWRnZSBbYXJyb3dzaXplID0gLjI1XQoKICB4MCAtPiB6MSBbbGFiZWwgPSAnYkBfezB9J10KICB4MSAtPiB6MSBbbGFiZWwgPSAnd0BfezB9J10KICB6MCAtPiB5ICBbbGFiZWwgPSAnYkBfezF9J10KICB6MSAtPiB5ICBbbGFiZWwgPSAnd0BfezF9J10KCn0iKQpgYGAKCk1hdGhlbWF0aWNhbGx5OgoKJCQKXGJlZ2lue2FsaWduZWR9ClxoYXR7eX0gCiY9IFxQaGkoYl8xICsgd18xeikgXFwKJj0gXFBoaShiXzEgKyB3XzFcUGhpKGJfMCArIHdfMHgpKSwKXGVuZHthbGlnbmVkfQokJAoKd2hlcmUKCiQkCnogPSBcUGhpKGJfMCArIHdfMHgpLAokJAoKYW5kCgokJApcUGhpKHQpID0gXGZyYWN7MX17MSArIGVeey10fX0uCiQkCgojIyMgTVNFIExvc3MKClRob3VnaCBpdCBtYXkgbm90IGJlIHZlcnkgbWVhbmluZ2Z1bCB0byB1c2UgTVNFIGxvc3Mgd2hlbiB0aGUgb3V0cHV0IGxheWVyIGlzIGFwcGxpZWQgd2l0aCBhbiBhY3RpdmF0aW9uIGZ1bmN0aW9uLAp3ZSBjYW4gc3RpbGwgZG8gaXQgZm9yIGVkdWNhdGlvbmFsIHB1cnBvc2UuCgokJApcbWJveHtNU0UtTG9zc30gPSBcZnJhY3sxfXtOfVxzdW1faV5OICAoeV9pIC0gXGhhdHt5fV9pKV4yLgokJAoKRmlyc3RseSB3ZSB0YWtlIHRoZSBkZXJpdmF0aXZlIHcuci50LiB0aGUgd2VpZ2h0IGluIHRoZSBsYXN0IGxheWVyOgoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje1xwYXJ0aWFsIFxtYm94e01TRS1Mb3NzfX17XHBhcnRpYWwgd18xfQomPSAtIFxmcmFjezF9e059XHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpXGZyYWN7XHBhcnRpYWwgXGhhdHt5fV9pfXtccGFydGlhbCB3XzF9IFxcCiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgKHlfaSAtIFxoYXR7eX1faSkKXHVuZGVyYnJhY2V7ICBcZnJhY3tccGFydGlhbCB0fXtccGFydGlhbCB3XzF9XGZyYWN7XHBhcnRpYWwgXFBoaSh0KX17XHBhcnRpYWwgdH0gfV97dCA9IGJfMSArIHdfMVxQaGkoYl8wICsgd18weCl9XFwKJj0gLSBcZnJhY3sxfXtOfVxzdW1faSAoeV9pIC0gXGhhdHt5fV9pKSBcY2RvdCBcUGhpKHQpKDEgLSBcUGhpKHQpKSBcY2RvdCB6X2kuClxlbmR7YWxpZ25lZH0KJCQKClNpbWlsYXJseSBmb3IgdGhlIGJpYXMgaW4gdGhlIGxhc3QgbGF5ZXI6CgokJApcZnJhY3tccGFydGlhbCBcbWJveHtNU0UtTG9zc319e1xwYXJ0aWFsIGJfMX0gPSAtIFxmcmFjezF9e059XHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpIFxjZG90IFxQaGkodCkoMSAtIFxQaGkodCkpLgokJAoKTm93IG1vdmUgb24gdG8gdGhlIGJpYXMgYW5kIHdlaWdodCBpbiB0aGUgZmlyc3QgbGF5ZXI6CgokJApcYmVnaW57YWxpZ25lZH0KXGZyYWN7XHBhcnRpYWwgXG1ib3h7TVNFLUxvc3N9fXtccGFydGlhbCB3XzB9CiY9IC0gXGZyYWN7MX17Tn1cc3VtX2kgKHlfaSAtIFxoYXR7eX1faSlcZnJhY3tccGFydGlhbCBcaGF0e3l9X2l9e1xwYXJ0aWFsIHdfMH0gXFwKJj0gLSBcZnJhY3sxfXtOfVxzdW1faSAoeV9pIC0gXGhhdHt5fV9pKQpcdW5kZXJicmFjZXsgIFxmcmFje1xwYXJ0aWFsIHR9e1xwYXJ0aWFsIHdfMH1cZnJhY3tccGFydGlhbCBcUGhpKHQpfXtccGFydGlhbCB0fSB9X3t0ID0gYl8xICsgd18xXFBoaShiXzAgKyB3XzB4KX1cXAomPSAtIFxmcmFjezF9e059XHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpIFxjZG90IFxQaGkodCkoMSAtIFxQaGkodCkpIFxjZG90IApcdW5kZXJicmFjZXsgXFBoaShrKSgxIC0gXFBoaShrKSkgfV97ayA9IGJfMCArd18weH0gXGNkb3Qgd18xIFxjZG90IHhfaSwgXFwKXGZyYWN7XHBhcnRpYWwgXG1ib3h7TVNFLUxvc3N9fXtccGFydGlhbCBiXzB9IAomPSAtIFxmcmFjezF9e059XHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpIFxjZG90IFxQaGkodCkoMSAtIFxQaGkodCkpIFxjZG90IFxQaGkoaykoMSAtIFxQaGkoaykpLgpcZW5ke2FsaWduZWR9CiQkCgpPbmUgY2FuIGNsZWFybHkgc2VlIHRoZXJlIGlzIGEgbGlua2FnZSBiZXR3ZWVuIHRoZSBkZXJpdmF0aXZlIG9mIHRoZSB3ZWlnaHRzIGluIGNvbnNlY3V0aXZlIGxheWVyczoKCiQkClxiZWdpbnthbGlnbmVkfQpcZnJhY3tccGFydGlhbCBcbWJveHtNU0UtTG9zc319e1xwYXJ0aWFsIHdfMX0KJj0gLSBcZnJhY3sxfXtOfVxzdW1faSAoeV9pIC0gXGhhdHt5fV9pKSBcY2RvdCBcUGhpKHQpKDEgLSBcUGhpKHQpKSBcY2RvdCB6X2ksIFxcClxmcmFje1xwYXJ0aWFsIFxtYm94e01TRS1Mb3NzfX17XHBhcnRpYWwgd18wfQomPSAtIFxmcmFjezF9e059XHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpIFxjZG90IApcdW5kZXJicmFjZXtcUGhpKHQpKDEgLSBcUGhpKHQpKX1fe1xoYXR7eX1faSgxIC0gXGhhdHt5fV9pKX0gXGNkb3QgClx1bmRlcmJyYWNle1xQaGkoaykoMSAtIFxQaGkoaykpIFxjZG90IHdfMSBcY2RvdCB4X2l9X3tcZnJhY3tccGFydGlhbCB3XzF6fXtccGFydGlhbCB3XzB9ID0gXGZyYWN7XHBhcnRpYWwgd18xXFBoaShiMCArIHdfMHgpfXtccGFydGlhbCB3XzB9fS4KXGVuZHthbGlnbmVkfQokJAoKIyMjIENyb3NzLUVudHJvcHkgTG9zcwoKU2ltaWxhcmx5IHdlIGNhbiBkZXJpdmUgdGhlIGdyYWRpZW50cyBmb3IgY3Jvc3MtZW50cm9weSBsb3NzLgoKJCQKXGJlZ2lue2FsaWduZWR9ClxtYm94e0xvZ0xvc3N9IAomPSAtIFxmcmFjezF9e059XHN1bV9pXk4gXGJpZ2dbIHlfaVxsblxoYXR7eX1faSArICgxIC0geV9pKVxsbigxIC0gXGhhdHt5fV9pKVxiaWdnXSwgXFwKXGZyYWN7XHBhcnRpYWwgXG1ib3h7TG9nTG9zc319e1xwYXJ0aWFsIHdfMX0KJj0gLSBcZnJhY3sxfXtOfSBcc3VtX2kgKHlfaSAtIFxoYXR7eX1faSl6X2ksIFxcClxmcmFje1xwYXJ0aWFsIFxtYm94e0xvZ0xvc3N9fXtccGFydGlhbCB3XzB9CiY9IC0gXGZyYWN7MX17Tn0gXHN1bV9pICh5X2kgLSBcaGF0e3l9X2kpXFBoaShrKSgxIC0gXFBoaShrKSl3XzF4X2kuXFwKXGVuZHthbGlnbmVkfQokJAoKKFNraXAgdGhlIGJpYXMgdGVybXMgdG8gc2F2ZSBzcGFjZS4pCgpOb3cgbGV0J3MgaW1wbGVtZW50IHRoZSBzaW1wbGUgbmV1cmFsIG5ldHdvcmsgbW9kZWwgaW4gUHl0aG9uOgoKYGBge3B5dGhvbiBubn0KZGVmIHNpZ21vaWQoeCk6CiAgcmV0dXJuIG5wLmV4cCgtbnAubG9nYWRkZXhwKDAsIC14KSkKCgpkZWYgc2lnbW9pZF9ncmFkKHopOgogIHJldHVybiB6KigxIC0geikKCgpjbGFzcyBOZXVyYWxOZXR3b3JrOgogICIiIlNpbXBsZSBuZXVyYWwgbmV0d29yayB3aXRoIDEgaGlkZGVuIGxheWVyIG9mIDQgbmV1cm9ucy4iIiIKICBkZWYgX19pbml0X18oc2VsZiwgeCwgeSk6CiAgICBzZWxmLmlucHV0ID0geAogICAgc2VsZi53MSA9IG5wLnJhbmRvbS5yYW5kKHNlbGYuaW5wdXQuc2hhcGVbMV0sIDQpCiAgICBzZWxmLncyID0gbnAucmFuZG9tLnJhbmQoNCwgMSkKICAgIHNlbGYueSA9IHkKICAgIHNlbGYub3V0cHV0ID0gbnAuemVyb3MoeS5zaGFwZSkKCiAgZGVmIGZlZWRmb3J3YXJkKHNlbGYpOgogICAgc2VsZi5sYXllcjEgPSBzaWdtb2lkKG5wLmRvdChzZWxmLmlucHV0LCBzZWxmLncxKSkKICAgIHNlbGYub3V0cHV0ID0gc2lnbW9pZChucC5kb3Qoc2VsZi5sYXllcjEsIHNlbGYudzIpKQoKICBkZWYgYmFja3Byb3Aoc2VsZiwgbHIpOgogICAgcmFpc2UgTm90SW1wbGVtZW50ZWRFcnJvcgogIAogIGRlZiB0cmFpbihzZWxmLCBsciwgbl9zdGVwKToKICAgIGZvciBzdGVwIGluIHJhbmdlKG5fc3RlcCk6CiAgICAgIHNlbGYuZmVlZGZvcndhcmQoKQogICAgICBzZWxmLmJhY2twcm9wKGxyPWxyKQogICAgICB5aGF0ID0gIiwiLmpvaW4oW3N0cih5KSBmb3IgeSBpbiBucC5zcXVlZXplKHNlbGYub3V0cHV0KV0pCiAgICByZXR1cm4geWhhdAoKCmNsYXNzIE5lcnVhbE5ldHdvcmtXaXRoTVNFTG9zcyhOZXVyYWxOZXR3b3JrKToKICBkZWYgYmFja3Byb3Aoc2VsZiwgbHIpOgogICAgIyBXZSBpZ25vcmUgYWxsIGNvbnN0YW50IHRlcm1zIGluIHRoZSBncmFkaWVudC4KICAgIHNlbGYuZHkgPSBzZWxmLnkgLSBzZWxmLm91dHB1dAogICAgZHcyID0gLSBucC5kb3Qoc2VsZi5sYXllcjEuVCwgKHNlbGYuZHkqc2lnbW9pZF9ncmFkKHNlbGYub3V0cHV0KSkpCiAgICBkdzEgPSAtIG5wLmRvdChzZWxmLmlucHV0LlQsIAogICAgICAgICAgICAgICAgICAgKG5wLmRvdChzZWxmLmR5KnNpZ21vaWRfZ3JhZChzZWxmLm91dHB1dCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgIHNlbGYudzIuVCkqc2lnbW9pZF9ncmFkKHNlbGYubGF5ZXIxKSkpCiAgICBzZWxmLncxIC09IGxyICogZHcxCiAgICBzZWxmLncyIC09IGxyICogZHcyCgoKY2xhc3MgTmVydWFsTmV0d29ya1dpdGhMb2dMb3NzKE5ldXJhbE5ldHdvcmspOgogIGRlZiBiYWNrcHJvcChzZWxmLCBscik6CiAgICAjIFdlIGlnbm9yZSBhbGwgY29uc3RhbnQgdGVybXMgaW4gdGhlIGdyYWRpZW50LgogICAgc2VsZi5keSA9IHNlbGYueSAtIHNlbGYub3V0cHV0CiAgICBkdzIgPSAtIG5wLmRvdChzZWxmLmxheWVyMS5ULCBzZWxmLmR5KQogICAgZHcxID0gLSBucC5kb3Qoc2VsZi5pbnB1dC5ULCAKICAgICAgICAgICAgICAgICAgIG5wLmRvdChzZWxmLmR5LCBzZWxmLncyLlQpKnNpZ21vaWRfZ3JhZChzZWxmLmxheWVyMSkpCiAgICBzZWxmLncxIC09IGxyICogZHcxCiAgICBzZWxmLncyIC09IGxyICogZHcyCmBgYAoKSGVyZSB3ZSB3aWxsIHVzZSB0aGUgaGVsbG8td29ybGQgZXhhbXBsZSBvZiBhcnRpZmljaWFsIG5ldXJhbCBuZXR3b3JrOgpUaGUgW1hPUl0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvWE9SX2dhdGUpIHByb2JsZW0uClRoZSBYT1IgbG9naWNhbCBvdXRjb21lLApiZXNpZGVzIGV4dHJlbWVseSBzaW1wbGUsCmlzIG5vdCBsaW5lYXJseSBzZXBhcmFibGUuClNvIGl0IHNlcnZlcyBhcyBhIGdvb2QgZXhhbXBsZSBvZiBzaG93Y2FzaW5nIG5ldXJhbCBuZXR3b3Jrcycgbm9uLWxpbmVhcml0eS4KClRoZSBpbnB1dCBkYXRhIGlzIHNpbXBseSBjb21iaW5hdGlvbiBvZiB0d28gYmluYXJ5IHN3aXRjaGVzLgooRm9yIGNvbXBsZXRlbmVzcyB3ZSBhbHNvIGluY2x1ZGUgYSBjb25zdGFudCB0ZXJtIHdoaWNoIGFsd2F5cyBldmFsdWF0ZSB0byAxIGFzIHRoZSBmaXJzdCBmZWF0dXJlLikKVGhlIG91dHB1dCBkYXRhIGlzIHRoZSBYT1IgcmVzdWx0LgoKYGBge3B5dGhvbiBubl94b3JfZGF0YX0KWG5uID0gbnAuYXJyYXkoCiAgICBbWzEsIDAsIDBdLAogICAgIFsxLCAxLCAwXSwKICAgICBbMSwgMCwgMV0sCiAgICAgWzEsIDEsIDFdXSkKeW5uID0gbnAuYXJyYXkoW1swXSwgWzFdLCBbMV0sIFswXV0pCgpwcmludChYbm4pICAjIElucHV0IGZlYXR1cmVzOiBCaWFzICsgdHdvIGJpbmFyeSBzd2l0Y2hlcy4KcHJpbnQoeW5uKSAgIyBYT1Igb3V0cHV0LgpgYGAKCk5vdyBsZXQncyBzZWUgaWYgb3VyIHNpbXBsZSBuZXVyYWwgbmV0d29yayBtb2RlbCBjYW4gbGVhcm4gdGhlIFhPUiBwYXR0ZXJuLgoKYGBge3B5dGhvbiBubl9nZF9tc2VfbG9zc30Kbm5fbXNlID0gTmVydWFsTmV0d29ya1dpdGhNU0VMb3NzKFhubiwgeW5uKQpwcmludChubl9tc2UudHJhaW4obHI9MSwgbl9zdGVwPTMwMDApKSAgIyBUaGUgcHJlZGljdGVkIFhPUiBvdXRjb21lLgpwcmludChubl9tc2UudzEpICAjIEVzdGltYXRlZCAxc3QtbGF5ZXIgbW9kZWwgd2VpZ2h0cwpwcmludChubl9tc2UudzIpICAjIEVzdGltYXRlZCAybmQtbGF5ZXIgbW9kZWwgd2VpZ2h0cwpgYGAKCmBgYHtweXRob24gbm5fZ2RfbG9nX2xvc3N9Cm5uX2xvZ2xvc3MgPSBOZXJ1YWxOZXR3b3JrV2l0aExvZ0xvc3MoWG5uLCB5bm4pCnByaW50KG5uX2xvZ2xvc3MudHJhaW4obHI9MSwgbl9zdGVwPTMwMDApKQpgYGAKCkZvciB0aGlzIHNpbXBsZSBleGFtcGxlLApib3RoIE1TRSBhbmQgY3Jvc3MtZW50cm9weSBsb3NzIGNhbiB3b3JrIGZpbmUgdG8gZmlndXJlIG91dCB0aGUgWE9SIHBhdHRlcm4uCihTdHJpY3RseSBzcGVha2luZyBjcm9zcy1lbnRyb3B5IGxvc3MgcGVyZm9ybXMgYmV0dGVyLikKCiMgUmVndWxhcml6YXRpb24KClJlZ3VsYXJpemF0aW9uIGlzIGEgdGVjaG5pcXVlIHRvIG1pdGlnYXRlIFtvdmVyZml0dGluZ10oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvT3ZlcmZpdHRpbmcpLgpJdCBpcyBub3QgcGFydGljdWxhciB0byBuZXVyYWwgbmV0d29ya3MgYnV0IGdlbmVyYWwgdG8gYWxsIG1hY2hpbmUgbGVhcm5pbmcgbW9kZWxzLgoKQSByZWd1bGFyaXphdGlvbiBpcyBhIGNvbnN0cmFpbnQgYWRkZWQgb250byB0aGUgb3JpZ2luYWwgb3B0aW1pemF0aW9uIHByb2JsZW0gKGxvc3MgbWluaW1pemF0aW9uKS4KQ29uc2lkZXIgbW9kZWwgd2VpZ2h0cyBhcyBhIHJlYWwgdmVjdG9yLAp3ZSB1c3VhbGx5IHVzZSB0aGUgW25vcm1dKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL05vcm1fKG1hdGhlbWF0aWNzKSkgb2YgdGhlIHZlY3RvciB0byBjb25zdHJhaW50IGl0cyBzaXplIGluIHRoZSBvcHRpbWl6YXRpb24uClRoZSBub3JtIGlzIGEgbWVhc3VyZSBvZiBzaXplIG9mIGEgdmVjdG9yLgpUaGUgZ2VuZXJhbCBpZGVhIGlzIHRvIGFkZCBhIHBlbmFsdHkgdG8gdGhlIHRhcmdldCBmdW5jdGlvbiAod2hpY2ggaXMgYSBsb3NzIGZ1bmN0aW9uKSBzdWNoIHRoYXQgaXQgZGlzY291cmFnZXMgdXNpbmcgbGFyZ2Ugd2VpZ2h0cyAod2hpY2ggaW5jcmVhc2UgdGhlIHNpemUgb2YgdmVjdG9yKSB0byBhY2hpZXZlIHRoZSBtaW5pbWl6YXRpb24gZ29hbC4KCkluIGdlbmVyYWwsCmEgTVNFIGxvc3MgbWluaW1pemF0aW9uIHdpdGggYSBwLW5vcm0gcmVndWxhcml6YXRpb24gZm9yIGEgbGluZWFyIG1vZGVsIGNhbiBiZSB3cml0dGVuIChpbiBtYXRyaXggZm9ybSkgYXM6CgokJApcYmVnaW57YWxpZ25lZH0KXGhhdHt5fSAmPSBYXG1hdGhybXtCfSwgXFwKXG9wZXJhdG9ybmFtZSp7YXJnbWlufV9cYmV0YSBcbWJveHtMb3NzfSAmPQpcZnJhY3sxfXtOfVxiaWdnWwpcdW5kZXJicmFjZXsoeSAtIFhcbWF0aHJte0J9KV5UKHkgLSBYXG1hdGhybXtCfSl9X1x0ZXh0e3N1bSBvZiBzcXVhcmVkIGVycm9yc30gKyAKXHVuZGVyYnJhY2V7XGxhbWJkYVxWZXJ0XG1hdGhybXtCfVxWZXJ0X3twfX1fXHRleHR7cC1ub3JtIHJlZ3VsYXJpemF0aW9ufQpcYmlnZ10sClxlbmR7YWxpZ25lZH0KJCQKCndpdGggYSBtb2RlbCB3ZWlnaHQgdmVjdG9yICRcbWF0aHJte0J9ID0gW1xiZXRhXzEsIFxiZXRhMiwgLi4uLCBcYmV0YV9rXSQuClRoZSBwYXJhbWV0ZXIgJFxsYW1iZGEkIGlzIGEgbmV3IGh5cGVyLXBhcmFtZXRlciBpbnRyb2R1Y2VkIGJ5IHRoZSByZWd1bGFyaXphdGlvbi4KCk9yIHB1dCBpdCBpbiBhIHNjYWxhciBmb3JtOgoKJCQKXGJlZ2lue2VxdWF0aW9ufSBcbGFiZWx7ZXE6bG9zc19taW5fcmVnfQpcb3BlcmF0b3JuYW1lKnthcmdtaW59X1xiZXRhIFxtYm94e0xvc3N9ID0KXGZyYWN7MX17Tn1cc3VtX3tpPTF9Xk5cYmlnZyggeV9pIC0gXG1hdGhybXtCfXhfaVxiaWdnKV4yICsgClxmcmFje1xsYW1iZGF9e059XGJpZ2coXHN1bV97aj0xfV5rXHZlcnRcYmV0YV9qXHZlcnRecFxiaWdnKV57MS9wfS4KXGVuZHtlcXVhdGlvbn0KJCQKClBvcHVsYXIgY2hvaWNlcyBvZiAkcCQgaXMgJHAgPSAxJCAoTDEtTm9ybSkgYW5kICRwID0gMiQgKEwyLU5vcm0pLgpOb3RhYmx5LAokcCQgY2FuIGJlIGFueSBub24taW50ZWdlciByZWFsIHZhbHVlIGFuZCB3b3VsZCBoYXZlIGV2ZW4gYmV0dGVyIHJlc3VsdCB0aGFuIGludGVnZXItbm9ybS4KQnV0IHRoZWlyIGNvbXB1dGF0aW9uYWwgZGlmZmljdWx0eSBtYWtlIHRoZW0gbXVjaCBsZXNzIGRlc2lyYWJsZSBpbiBwcmFjdGljZS4KCkluIHByYWN0aWNlLAp3ZSBhbHNvIGlnbm9yZSB0aGUgcm9vdCBpbiB0aGUgbm9ybSBmb3IgY29tcHV0YXRpb25hbCBzaW1wbGljaXR5LgpTbyB0aGUgcHJvYmxlbSBpbmRlZWQgYmVjb21lcwoKJCQKXG9wZXJhdG9ybmFtZSp7YXJnbWlufV9cYmV0YSBcbWJveHtMb3NzfSA9ClxmcmFjezF9e059XHN1bV97aT0xfV5OXGJpZ2coIHlfaSAtIFxtYXRocm17Qn14X2lcYmlnZyleMiArIApcZnJhY3tcbGFtYmRhfXtOfVxiaWdnKFxzdW1fe2o9MX1ea1x2ZXJ0XGJldGFfalx2ZXJ0XnBcYmlnZykuCiQkCgpUaGVyZSBpcyBhbHNvIGEgc28tY2FsbGVkIFtlbGFzdGljbmV0IHJlZ3VsYXJpemF0aW9uXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9FbGFzdGljX25ldF9yZWd1bGFyaXphdGlvbikgd2hpY2ggY29tYmluZXMgYm90aCBMMSBhbmQgTDIgbm9ybXMgdG9nZXRoZXIgdG8gZ2l2ZSBwb3RlbnRpYWxseSBiZXR0ZXIgcmVzdWx0LgpIb3dldmVyIGl0IHJlcXVpcmVzIGEgbG90IG1vcmUgY29tcHV0aW5nIHJlc291cmNlcyBhbmQgaGVuY2UgYmVjb21lIG11Y2ggbGVzcyBmZWFzaWJsZSBpbiBhIG5ldXJhbCBuZXR3b3JrIG1vZGVsLgoKIyMgTDItTm9ybSBSZWd1bGFyaXphdGlvbgoKVGhlIEwyLU5vcm0gc2hyaW5rcyB0aGUgc2l6ZSBvZiBtb2RlbCB3ZWlnaHRzLgpUaG9zZSB3aG8gY29udHJpYnV0ZSBsZXNzIHRvIGxvc3MgbWluaW1pemF0aW9uIHdpbGwgc2hyaW5rIG1vcmUuCgpCYWNrIHRvIG91ciB1bml2YXJpYXRlIGxpbmVhciBtb2RlbCAkXGhhdHt5fV9pID0gXGJldGFfMCArIFxiZXRhXzF4X2kkIGZvciBzeW1vbGljIHNpbXBsaWNpdHkuCk91ciBNU0UgbG9zcyBpcyAKCiQkClxtYm94e01TRS1Mb3NzfSA9IFxmcmFjezF9e059XHN1bV9pXGJpZ1t5X2ktKFxiZXRhXzAgKyBcYmV0YV8xeF9pKVxiaWddXjIgKyBcZnJhY3tcbGFtYmRhfXtOfShcYmV0YV8wXjIgKyBcYmV0YV8xXjIpLgokJAoKU2luY2UgdGhlIHBlbmF0eSBpcyBhZGRpdGl2ZSwKb3VyIGdyYWRpZW50IHNvbHV0aW9uIGlzIGV4dHJlbWVseSBlYXN5OgoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje1xwYXJ0aWFsXG1ib3h7TVNFLUxvc3N9fXtccGFydGlhbFxiZXRhXzB9IAomPSAtIFxmcmFjezJ9e059XHN1bV9pIFxiaWdbIHlfaSAtIChcYmV0YV8wICsgXGJldGFfMXhfaSkgXGJpZ10gKyBcZnJhY3syfXtOfVxsYW1iZGFcYmV0YV8wLCBcXApcZnJhY3tccGFydGlhbFxtYm94e01TRS1Mb3NzfX17XHBhcnRpYWxcYmV0YV8xfSAKJj0gLSBcZnJhY3syfXtOfVxzdW1faSBcYmlnWyB5X2kgLSAoXGJldGFfMCArIFxiZXRhXzF4X2kpIFxiaWddeF9pICsgXGZyYWN7Mn17Tn1cbGFtYmRhXGJldGFfMS4KXGVuZHthbGlnbmVkfQokJAoKQSBsaW5lYXIgcmVncmVzc2lvbiBtb2RlbCB3aXRoIGwyIHJlZ3VsYXJpemF0aW9uIGlzIHJlZmVycmVkIHRvIGFzIHRoZSByaWRnZSByZWdyZXNzaW9uLgpCZSBhd2FyZSB0aGF0IGluIGltcGxlbWVudGluZyB0aGUgYmF0Y2ggb3B0aW1pemVyIHdlIG5lZWQgdG8gc2NhbGUgZG93biB0aGUgdXBkYXRlIGZyb20gbDIgbm9ybSBieSB0aGUgc2l6ZSBvZiBiYXRjaCBpbiBvcmRlciB0byBiYWxhbmNlIHRoZSBzaXplIG9mIGwyIG5vcm0gYW5kIHRoZSBvcmlnaW5hbCBsb3NzLgoKYGBge3B5dGhvbiByaWdkZV9yZWd9CmRlZiBtc2VfZ3JhZF9sMihYLCB5LCBiZXRhKToKICBhID0gMSAgIyBIYXJkY29kZSB0aGUgcmVndWxhcml6YXRpb24gY29lZmZpY2llbnQgZm9yIHNpbXBsaWNpdHkuCiAgcmV0dXJuIC0yICogKCh5IC0gWC5kb3QoYmV0YSkpLmRvdChYKSkgLyBYLnNoYXBlWzBdICsgMiAqIGEgKiBiZXRhIC8gWC5zaGFwZVswXQoKYmF0Y2hfYmV0YSwgYmF0Y2hfbG9zcyA9IGdkX2JhdGNoX29wdGltaXplKFgsIHksIG1zZV9ncmFkX2wyLCBuX2Vwb2NoPTEwMCwgYmF0Y2hfc2l6ZT02NCkKcHJpbnQoYmF0Y2hfYmV0YSkKYGBgCgpUaGUgcmVzdWx0aW5nIGVzdGltYXRlcyBhcmUgc21hbGxlciB0aGFuIHRoZSB2YW5pbGxhIGdyYWRpZW50IGRlc2NlbnQuCgpPbmUgdGhpbmcgd29ydGggbm90aW5nIGlzIHRoYXQgd2hlbiBiYXRjaCBncmFkaWVudCBkZXNjZW50IGlzIHVzZWQgYWxvbmcgd2l0aCByZWd1bGFyaXphdGlvbiwKYSBzaWRlIGVmZmVjdCBleGlzdHMgZHVlIHRvIHRoZSBzY2FsaW5nIG9mIHRoZSBiYXRjaCBzaXplIG9uIHRoZSByZWd1bGFyaXphdGlvbiB0ZXJtLgoKRXhwZXJpbWVudHMgd2l0aCBkaWZmZXJlbnQgYmF0Y2ggc2l6ZXMgd2l0aCBsMiByZWd1bGFyaXphdGlvbjoKCmBgYHtweXRob24gcmlkZ2VfcmVnX2RpZmZlcl9iYXRjaF9zaXplfQpmb3IgYnNpemUgaW4gWzgsIDE2LCAzMiwgNjQsIDEyOCwgMjU2LCA1MTIsIDEwMDBdOgogIHByaW50KCJCYXRjaCBTaXplOiB7OjR9IHwgRXN0aW1hdGU6IHt9Ii5mb3JtYXQoCiAgICBic2l6ZSwKICAgIGdkX2JhdGNoX29wdGltaXplKFgsIHksIG1zZV9ncmFkX2wyLCBuX2Vwb2NoPTUwMCwgYmF0Y2hfc2l6ZT1ic2l6ZSlbMF0pKQpgYGAKCkxldCdzIGNoZWNrIHRoZSByZXN1bHQgdXNpbmcgYHNrbGVhcm5gJ3MgYFJpZGdlYCByZWdyZXNzb3IgKHdoaWNoIGRvZXNuJ3QgdXNlIGdyYWRpZW50IGRlc2NlbnQgYXMgaXRzIHNvbHZlcik6CgpgYGB7cHl0aG9uIHJpZGdlX3JlZ19za2xlYXJufQojIFdlIHNldCBmaXRfaW50ZXJjZXB0PUZhbHNlIHNpbmNlIG91ciBkZXNpZ24gbWF0cml4IGFscmVhZHkgY29udGFpbnMgaW50ZXJjZXB0LgojIEFjY29yZGluZyB0byB0aGUgZG9jIHRoZSBjb25zdGFudCAyIGluIHRoZSBkZXJpdmF0aXZlIGlzIG5vdCBpbmNsdWRlZCBzbyB3ZSBzZXQgYWxwaGEgPSAyLgpmcm9tIHNrbGVhcm4ubGluZWFyX21vZGVsIGltcG9ydCBSaWRnZQpwcmludChSaWRnZShhbHBoYT0yLCBmaXRfaW50ZXJjZXB0PUZhbHNlKS5maXQoWCwgeSkuY29lZl8pCmBgYAoKVGhlIHJlc3VsdCBpcyBjbG9zZWQgdG8gZ3JhZGllbnQgZGVzY2VudCB3aXRoIG5lYXJseSBhIGZ1bGwtYmF0Y2ggdXBkYXRlIChpLmUuLCB1c2UgdGhlIGVudGlyZSB0cmFpbmluZyBkYXRhIGZvciBvbmUgdXBkYXRlKS4KCkV4YWN0bHkgdGhlIHNhbWUgbG9naWMgY2FuIGFwcGx5IHRvIGxvZ2lzdGljIHJlZ3Jlc3Npb24gYW5kIGlzIG5vdCBkaXNjdXNzZWQgaGVyZSB0byBhdm9pZCByZWR1bmRhbmN5LgoKIyMgTDEtTm9ybSBSZWd1bGFyaXphdGlvbgoKVGhlIEwxLU5vcm0gcHJlZmVycyBzcGFyc2l0eSBpbiB0aGUgbW9kZWwgd2VpZ2h0cy4KVGhhdCBpcywKaXQgbWF5IHplcm8gb3V0IHdlaWdodHMgdGhhdCBhcmUgbm90IGNvbnRyaWJ1dGluZyB0byB0aGUgbG9zcy4KV2hpbGUgdGhlIEwyLU5vcm0gb25seSBtYWtlcyB0aGVtIGFyYml0cmFyaWx5IHNtYWxsLgoKTVNFIGxvc3Mgd2l0aCBsMSBub3JtOgoKJCQKXG1ib3h7TVNFLUxvc3N9ID0gXGZyYWN7MX17Tn1cc3VtX2lcYmlnW3lfaS0oXGJldGFfMCArIFxiZXRhXzF4X2kpXGJpZ11eMiArIFxsYW1iZGEoXHZlcnRcYmV0YV8wXHZlcnQgKyBcdmVydFxiZXRhXzFcdmVydCksCiQkCgp3aXRoIGdyYWRpZW50czpeW05vdGUgdGhhdCB0aGUgZGVyaXZhdGl2ZSAkXGZyYWN7ZHV9e2R4fSA9IFxmcmFje3V9e1x2ZXJ0IHUgXHZlcnR9XGZyYWN7ZHV9e2R4fSQgYXQgJHUgPSAwJCBpcyB1bmRlZmluZWQuXQoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje1xwYXJ0aWFsXG1ib3h7TVNFLUxvc3N9fXtccGFydGlhbFxiZXRhXzB9IAomPSAtIFxmcmFjezJ9e059XHN1bV9pIFxiaWdbIHlfaSAtIChcYmV0YV8wICsgXGJldGFfMXhfaSkgXGJpZ10gKyBcbGFtYmRhXGZyYWN7XGJldGFfMH17XHZlcnRcYmV0YV8wXHZlcnR9LCBcXApcZnJhY3tccGFydGlhbFxtYm94e01TRS1Mb3NzfX17XHBhcnRpYWxcYmV0YV8xfSAKJj0gLSBcZnJhY3syfXtOfVxzdW1faSBcYmlnWyB5X2kgLSAoXGJldGFfMCArIFxiZXRhXzF4X2kpIFxiaWddeF9pICsgXGxhbWJkYVxmcmFje1xiZXRhXzF9e1x2ZXJ0XGJldGFfMVx2ZXJ0fS4KXGVuZHthbGlnbmVkfQokJAoKQSBsaW5lYXIgcmVncmVzc2lvbiBtb2RlbCB3aXRoIGwxIHJlZ3VsYXJpemF0aW9uIGlzIHJlZmVycmVkIHRvIGFzIHRoZSBsYXNzbyByZWdyZXNzaW9uLgpMZXQncyBmaXJzdCBjaGVjayB0aGUgcmVzdWx0IHVzaW5nIGBza2xlYXJuYCdzIGBMYXNzb2AgcmVncmVzc29yICh3aGljaCB1c2VzIGEgY29vcmRpbmF0ZSBkZXNjZW50IHNvbHZlcik6CgpgYGB7cHl0aG9uIGxhc3NvX3JlZ19za2xlYXJufQojIFdlIHNldCBmaXRfaW50ZXJjZXB0PUZhbHNlIHNpbmNlIG91ciBkZXNpZ24gbWF0cml4IGFscmVhZHkgY29udGFpbnMgaW50ZXJjZXB0Lgpmcm9tIHNrbGVhcm4ubGluZWFyX21vZGVsIGltcG9ydCBMYXNzbwpwcmludChMYXNzbyhhbHBoYT0xLCBmaXRfaW50ZXJjZXB0PUZhbHNlKS5maXQoWCwgeSkuY29lZl8pCmBgYAoKVG8gZGVyaXZlIHJvdWdobHkgdGhlIHNhbWUgcmVzdWx0LAp3ZSBuZWVkIHRvIGNhbGlicmF0ZSB0aGUgY29lZmZpY2llbnQgb24gcmVndWxhcml6YXRpb24gaW4gb3VyIGdyYWRpZW50IGRlc2NlbnQgc29sdmVyOgoKYGBge3B5dGhvbiBsYXNzb19yZWd9CmRlZiBtc2VfZ3JhZF9sMShYLCB5LCBiZXRhKToKICAjIGEgaXMgc2V0IHRvIDIgc2luY2UgaW4gc2tsZWFybiBjb252ZW50aW9uIHRoZSBlbnRpcmUgbG9zcyBpcyBzY2FsZWQgYnkgYSBmYWN0b3Igb2YgMS8yCiAgIyB0byBjYW5jZWwgb3V0IHRoZSBkZXJpdmF0aXZlIGNvbnN0YW50IG9uIHRoZSBzcXVhcmVkIGVycm9yIHRlcm0uCiAgYSA9IDIKICByZXR1cm4gLTIgKiAoKHkgLSBYLmRvdChiZXRhKSkuZG90KFgpKSAvIFguc2hhcGVbMF0gKyBhICogbnAuc2lnbihiZXRhKQoKIyBXZSB1c2UgYSBmdWxsLWJhdGNoIGdyYWRpZW50IGRlc2NlbnQgaGVyZS4KYmF0Y2hfYmV0YSwgYmF0Y2hfbG9zcyA9IGdkX2JhdGNoX29wdGltaXplKFgsIHksIG1zZV9ncmFkX2wxLCBuX2Vwb2NoPTEwMDAsIGJhdGNoX3NpemU9MTAwMCkKcHJpbnQoYmF0Y2hfYmV0YSkKYGBgCgpXZSBjYW4gYWxzbyBjaGVjayB0aGUgY29uc2lzdGVuY3kgYnkgY2FsbGluZyBgc2tsZWFybmAncyBgU0dEUmVncmVzc29yYDoKCmBgYHtweXRob24gbGFzc29fcmVnX3NrbGVhcm5fc2dkfQpmcm9tIHNrbGVhcm4ubGluZWFyX21vZGVsIGltcG9ydCBTR0RSZWdyZXNzb3IKcHJpbnQoU0dEUmVncmVzc29yKHBlbmFsdHk9ImwxIiwgYWxwaGE9MSwgZml0X2ludGVyY2VwdD1GYWxzZSkuZml0KFgsIHkpLmNvZWZfKQpgYGAKCk5vdyBsZXQncyBwdXJwb3NlbHkgYWRkIG9uZSByYW5kb20gZmVhdHVyZSBhcyBhIG5vaXNlIGludG8gdGhlIGRlc2lnbiBtYXRyaXggYW5kIHNlZSBob3cgdGhlIHJlZ3VsYXJpemF0aW9uIGhlbHBzIHRvIHNocmluayB0aGUgd2VpZ2h0IG9mIHRoZSBub2lzZS4KCmBgYHtweXRob24gc2hyaW5rYWdlX2V4cH0KIyBJbnRyb2R1Y2UgYSB0b3RhbGx5IGlycmVsZXZhbnQgZmVhdHVyZSBpbnRvIG91ciBsaW5lYXIgbW9kZWwuCm5vaXNlID0gbnAucmFuZG9tLnVuaWZvcm0oc2l6ZT1OKS5yZXNoYXBlKE4sIDEpClhub2lzZSA9IG5wLmNvbmNhdGVuYXRlKFtYLCBub2lzZV0sIGF4aXM9MSkKCnByaW50KFJpZGdlKGFscGhhPTIsIGZpdF9pbnRlcmNlcHQ9RmFsc2UpLmZpdChYbm9pc2UsIHkpLmNvZWZfKQoKcHJpbnQoTGFzc28oYWxwaGE9MSwgZml0X2ludGVyY2VwdD1GYWxzZSkuZml0KFhub2lzZSwgeSkuY29lZl8pCmBgYAoKQXMgb25lIGNhbiBzZWUsCmBMYXNzb2AgcmVncmVzc29yIGlzIGFibGUgdG8gY29tcGxldGVseSB3aXBlIG91dCB0aGUgd2VpZ2h0IG9uIHRoZSByZWR1bmRhbnQgbm9pc2UsCndoaWxlIGBSaWRnZWAgY2FuIG9ubHkgc2hyaW5rIGl0IHRvd2FyZCB6ZXJvLgoKVG8gYXJyaXZlIHJvdWdobHkgYXQgdGhlIHNhbWUgcmVzdWx0IG9mIGBSaWRnZWAgdXNpbmcgb3VyIHNpbXBsZSBncmFkaWVudCBkZXNjZW50IHNvbHZlcjoKCmBgYHtweXRob24gc2hyaW5rYWdlX2V4cF9yaWdkZV9zZ2R9CnByaW50KGdkX2JhdGNoX29wdGltaXplKFhub2lzZSwgeSwgbXNlX2dyYWRfbDIsIGxyPS4wMywgbl9lcG9jaD0xMDAwLCBiYXRjaF9zaXplPTEwMDApWzBdKQpgYGAKCkFuZCBmb3IgdGhlIGBMYXNzb2AgY2FzZToKCmBgYHtweXRob24gc2hyaW5rYWdlX2V4cF9sYXNzb19zZ2R9CnByaW50KGdkX2JhdGNoX29wdGltaXplKFhub2lzZSwgeSwgbXNlX2dyYWRfbDEsIGxyPS4wMywgbl9lcG9jaD0xMDAwLCBiYXRjaF9zaXplPTEwMDApWzBdKQpgYGAKCk9uZSB0aGluZyB0byBub3RlOgpJdCBpcyBpbiBnZW5lcmFsIGRpZmZpY3VsdCB0byBhcnJpdmUgYXQgc3BhcnNlIHNvbHV0aW9uICgwIHdlaWdodCkgZm9yIGEgbmFpdmUgZ3JhZGllbnQgZGVzY2VudCBpbXBsZW1lbnRhdGlvbiBzdWNoIGFzIG91cnMuClNvbWUgZnVydGhlciBtYXRoZW1hdGljYWwgdHJpY2tzIGxpa2UgdGhlIFtwcm94aW1hbCBncmFkaWVudCBtZXRvaGRdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1Byb3hpbWFsX2dyYWRpZW50X21ldGhvZCkgbXVzdCBiZSBhcHBsaWVkIGluIG9yZGVyIHRvIHByb2R1Y2Ugc3BhcnNlIHJlc3VsdCB1bmRlciBmaW5pdGUgaXRlcmF0aW9ucy4KCkZpbmFsbHksCmFnYWluLApleGFjdGx5IHRoZSBzYW1lIGxvZ2ljIGNhbiBhcHBseSB0byBsb2dpc3RpYyByZWdyZXNzaW9uIGFuZCBpcyBub3QgZGlzY3Vzc2VkIGZ1cnRoZXIgdG8gYXZvaWQgcmVkdW5kYW5jeS4KCiMjIEdlb21ldHJpYyBJbnRlcnByZXRhdGlvbiBvZiBMMS9MMiBSZWd1bGFyaXphdGlvbgoKQ29uc2lkZXIgYSB0d28tcGFyYW1ldGVyIG1vZGVsaW5nIGNhc2UsCndoZXJlIHdlIHBsb3QgdGhlIHR3byBwb3NzaWJsZSB3ZWlnaHRzICR3XzEkIGFuZCAkd18yJCBhcyBhIEV1Y2xpZGVhbiBjb29yZGluYXRlIHN5c3RlbS4KVGhlIE1TRSBsb3NzIG1pbmltaXphdGlvbiBwcm9ibGVtIHN0YXRlZCBpbiBlcXVhdGlvbiAkXGVxcmVme2VxOm9sc30kIGNhbiBiZSByZXdyaXR0ZW4gYXMgYW4gKm9wdGltaXphdGlvbiB3aXRoIGxpbmVhciBjb25zdHJhaW50KjoKCiQkClxiZWdpbnthbGlnbmVkfQomIFxvcGVyYXRvcm5hbWUqe2FyZ21pbn1fXGJldGEKJiAmIFxmcmFjezF9e059XHN1bV97aT0xfV5OXGJpZ2coIHlfaSAtIFxtYXRocm17Qn14X2lcYmlnZyleMiBcXAomIFx0ZXh0e3N1YmplY3QgdG99CiYgJiBcYmlnZyhcc3VtX3tqPTF9XmtcdmVydFxiZXRhX2pcdmVydF5wXGJpZ2cpXnsxL3B9IFxsZSB0LgpcZW5ke2FsaWduZWR9CiQkCgpTb2x2aW5nIHRoZSBhYm92ZSBwcm9ibGVtICh1c2luZyBmb3IgZXhhbXBsZSB0aGUgbWV0aG9kIG9mIExhZ3JhbmdlIG11bHRpcGxpZXJzKSB3aWxsIHJlc3VsdCBpbiBleGFjdGx5IHRoZSBzYW1lIHRhcmdldCBmdW5jdGlvbiBhcyBpbiBlcXVhdGlvbiAkXGVxcmVme2VxOm9sc30kLgoKTm93IGlmIHdlIHBsb3QgdGhlIGxpbmVhciBjb25zdHJhaW50IG9uIHRoZSBFdWNsaWRlYW4gc3BhY2UgKGZvciB0aGUgY2FzZSBvZiAkayA9IDIkIGFuZCBhbiBhcmJpdHJhcnkgdmFsdWUgb2YgY29uc3RhbnQgJHQkKSwKdGhlIHBvc3NpYmxlIHBhcmFtZXRlciBjb21iaW5hdGlvbiB3aWxsIGZhbGwgaW50byBhIGNpcmxlIGZvciAkcCA9IDIkIChMMiByZWd1bGFyaXphdGlvbikgb3IgYSBzcXVhcmVkIGRpYW1vbmQgZm9yICRwID0gMSQgKEwxIHJlZ3VsYXJpemF0aW9uKSwKYm90aCBjZW50ZXJlZCBhdCB0aGUgb3JpZ2luLgoKYGBge3B5dGhvbiBnZW9tX2wyfQp0ID0gMiAgIyBBZC1ob2MgY29uc3RhbnQgY29uc3RyYWludCBvbiB0aGUgbm9ybS4KCiMgQ29kZSBzb21lIHJldXNhYmxlIG9iamVjdHMuCnNoYXBlcyA9IFsKICBkaWN0KHR5cGU9ImNpcmNsZSIsIHgwPS10LCB5MD0tdCwgeDE9dCwgeTE9dCwKICAgICAgIGZpbGxjb2xvcj0iZGFya2dyZWVuIiwgb3BhY2l0eT0wLjI1LCBsaW5lPWRpY3QoY29sb3I9ImRhcmtncmVlbiIpKSwKICBkaWN0KHR5cGU9InBhdGgiLCBwYXRoPSJNIDAsLXt0fSBMLXt0fSwwIEwwLHt0fSBMe3R9LDAgWiIuZm9ybWF0KHQ9dCksCiAgICAgICBmaWxsY29sb3I9ImJsdWUiLCBvcGFjaXR5PTAuMjUsIGxpbmU9ZGljdChjb2xvcj0iYmx1ZSIpKV0KdzFfYXhpcyA9IGRpY3QodGl0bGU9ciIkd197MX0kIiwgcmFuZ2U9Wy10KjEuNSwgdCoxLjVdKQp3Ml9heGlzID0gZGljdCh0aXRsZT1yIiR3X3syfSQiLCByYW5nZT1bLXQqMS41LCB0KjEuNV0sIHNjYWxlYW5jaG9yPSJ4Iiwgc2NhbGVyYXRpbz0xKQoKb2ZpbGUgPSAicGxvdHMvcmVnX2dlb20uaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVsKICAgIGdvLlNjYXR0ZXIoCiAgICAgIHg9W3QrMV0sIHk9W3RdLCBtb2RlPSJ0ZXh0IiwgbmFtZT0iTDIgUmVndWxhcml6YXRpb24iLAogICAgICB0ZXh0PVtyIiRcc3FydHt3XzFeMSArIHdfMl4yfSA8PSAiICsgInt9JCIuZm9ybWF0KHQpXSwKICAgICAgdGV4dGZvbnQ9ZGljdChjb2xvcj0iZGFya2dyZWVuIikpLAogICAgZ28uU2NhdHRlcigKICAgICAgeD1bdCsxXSwgeT1bLXRdLCBtb2RlPSJ0ZXh0IiwgbmFtZT0iTDEgUmVndWxhcml6YXRpb24iLAogICAgICB0ZXh0PVtyIiRcdmVydCB3XzEgXHZlcnQgKyBcdmVydCB3XzIgXHZlcnQgPD0gIiArICJ7fSQiLmZvcm1hdCh0KV0sCiAgICAgIHRleHRmb250PWRpY3QoY29sb3I9ImJsdWUiKSkKICBdLAogIGxheW91dD1nby5MYXlvdXQodGl0bGU9IlBhcmFtZXRlciBTcGFjZSIsIHNob3dsZWdlbmQ9VHJ1ZSwKICAgICAgICAgICAgICAgICAgIHhheGlzPXcxX2F4aXMsIHlheGlzPXcyX2F4aXMsIHNoYXBlcz1zaGFwZXMpKQpgYGAKCmBgYHtyLCBlY2hvPUZBTFNFfQpodG1sdG9vbHM6OmluY2x1ZGVIVE1MKHB5JG9maWxlKQpgYGAKClNpbXBseSBwbG90IHRoZSBjb25zdHJhaW50IGFyZWEgaXMgbm90IHRoYXQgaW5mb3JtYXRpdmUuCldlIG5lZWQgdG8gYWxzbyB2aXN1YWxpemUgdGhlIHBvc3NpYmxlIHZhbHVlcyBvZiBsb3NzIGZ1bmN0aW9uLgoKTGV0J3MgdXNlIHRoZSB0b3kgbW9kZWwgaW4gb3VyIHByZXZpb3VzIGxpbmVhciByZWdyZXNzaW9uIHNlY3Rpb24gdG8gZG8gdGhlIHZpc3VhbGl6YXRpb24uCldlIHdpbGwgaXRlcmF0ZSBvdmVyIHRoZSBjb29yZGluYXRlIHNwYWNlIHdpdGhpbiAkMCA8PSB3MSA8PSAxMCQgYW5kICQwIDw9IHcyIDw9IDEwJCB0byBjb2xsZWN0IGFsbCBwb3NzaWJsZSByZXN1bHRpbmcgbG9zcyB2YWx1ZXMuClRoZSBsb3NzIHdpbGwgYmUgYSAzcmQgYXhpcyBhZGRlZCBvbnRvIHRoZSBleGlzdGluZyBwbGFpbi4KCmBgYHtweXRob24gM2RfbG9zc193ZWlnaHRzfQp6X2xvc3MgPSBbXQpfeCA9IG5wLmFyYW5nZSgtMTAsIDEwKQpfeSA9IG5wLmFyYW5nZSgtMTAsIDEwKQpmb3IgX3cxIGluIF94OgogIGZvciBfdzIgaW4gX3k6CiAgICB6X2xvc3MuYXBwZW5kKGxvc3MoWCwgeSwgW193MSwgX3cyXSkpCnpfbG9zcyA9IG5wLmFzYXJyYXkoel9sb3NzKS5yZXNoYXBlKDIwLCAyMCwgb3JkZXI9IkYiKQpgYGAKCmBgYHtweXRob24gM2RfbG9zc19wbG90fQp3MSwgdzIgPSBvbHMoWCwgeSkgICMgVW5yZWd1bGFyaXplZCBPTFMgc29sdXRpb24uCgpvZmlsZSA9ICJwbG90cy8zZF9sb3NzLmh0bWwiCnAgPSBwbG90X29mZmxpbmUoCiAgb2ZpbGU9b2ZpbGUsCiAgZGF0YT1bCiAgICBnby5TdXJmYWNlKAogICAgICB4PV94LCB5PV95LCB6PXpfbG9zcywKICAgICAgY29udG91cnM9Z28uc3VyZmFjZS5Db250b3VycygKICAgICAgICB6PWdvLnN1cmZhY2UuY29udG91cnMuWigKICAgICAgICAgIHNob3c9VHJ1ZSwKICAgICAgICAgIHVzZWNvbG9ybWFwPVRydWUsCiAgICAgICAgICBoaWdobGlnaHRjb2xvcj0iIzQyZjQ2MiIsCiAgICAgICAgICBwcm9qZWN0PWRpY3Qoej1UcnVlKSkpKSwKICAgIGdvLlNjYXR0ZXIzZCgKICAgICAgeD1bdzFdLCB5PVt3Ml0sIHo9WzBdLCBtb2RlPSJtYXJrZXJzIiwKICAgICAgbWFya2VyPWRpY3Qoc3ltYm9sPSJjcm9zcyIsIGNvbG9yPSJibHVlIikpCiAgXSwKICBsYXlvdXQ9Z28uTGF5b3V0KAogICAgdGl0bGU9Ik1TRSBMb3NzIG9uIFBhcmFtZXRlciBTcGFjZSIsCiAgICBzY2VuZT1kaWN0KAogICAgICAjIExhdGV4IG5vdGF0aW9uIGRvZXNuJ3Qgd29yayBpbiAzZCByZW5kZXIuIEtub3duIGlzc3VlIG9mIHBsb3RseS5qcy4KICAgICAgeGF4aXM9ZGljdCh0aXRsZT0idzEiKSwKICAgICAgeWF4aXM9ZGljdCh0aXRsZT0idzIiKSwKICAgICAgemF4aXM9ZGljdCh0aXRsZT0iTG9zcyIpKSkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0UsIGZpZy53aWR0aD0xMCwgZmlnLmhlaWdodD0xMH0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpOb3RlIHRoYXQgd2UgYWxzbyBwbG90IHRoZSBjb250b3VyIG9uIHRoZSBvcmlnaW5hbCAyLWQgcGxhaW4uClRoZSBjb250b3VyIGRlcGljdHMgYWxsIHRoZSB3ZWlnaHQgY29tYmluYXRpb25zIHRoYXQgbGVhZCB0byB0aGUgc2FtZSBhbW91bnQgb2YgbG9zcy4KQW5kIHdlIG1hcmsgdGhlIG1pbmltdW0gd2l0aCBhIGNyb3NzIHRvIGNsZWFybHkgcG9pbnQgb3V0IHRoZSBvcHRpbXVtIGxvc3Mgd2hpY2ggY2FuIGJlIGFjaGlldmVkIGJ5IHRoZSB1bnJlZ3VsYXJpemVkIE9MUyBlc3RpbWF0b3IgaW4gZXF1YXRpb24gJFxlcXJlZntlcTpvbHN9JC4KCk5vdyBpZiB3ZSBjb21iaW5lIHRoZSB0d28gcGxvdHMgdG9nZXRoZXIsCmVzcGVjaWFsbHkgdGhlIGNvbnRvdXIgb24gdGhlIHBhcmFtZXRlciBwbGFpbiwKdGhlIHRhbmdlbnQgcG9pbnQgYmV0d2VlbiB0aGUgcmVndWxhcml6YXRpb24gYXJlYSBhbmQgdGhlIGNvbnRvdXIgaXMgZXhhY3RseSBvdXIgcmVndWxhcml6ZWQgc29sdXRpb24gZm9yIHRoZSB3ZWlnaHRzLl5bU2luY2UgcGxvdGx5LmpzIGN1cnJlbnRseSBkb2Vzbid0IHN1cHBvcnQgdW5ldmVuIGludGVydmFsIGZvciBjb250b3VyIHBsb3QsIGluIHRoZSBjb250b3VyLXJlZ3VsYXJpemF0aW9uIHBsb3Qgd2UgdGFrZSBuYXRydWFsIGxvZyBvZiBNU0UganVzdCB0byBzY2FsZSB0aGUgdmFsdWUgc28gdGhhdCB0aGUgY29udG91ciBsaW5lIHdpbGwgaGF2ZSBub24tbGluZWFyIGludGVydmFsLiBUaGlzIGhlbHAgdXMgc2hvdyBtb3JlIGxpbmVzIHdoZW4gbG9zcyBiZWNvbWVzIHNtYWxsZXIuXQoKYGBge3B5dGhvbiBsb3NzX2NvbnRvdXJfcmVnX3Bsb3R9Cm9maWxlID0gInBsb3RzL2xvc3NfY29udG91cl9yZWcuaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVsKICAgIGdvLkNvbnRvdXIoCiAgICAgIHg9X3gsIHk9X3ksIHo9bnAubG9nKHpfbG9zcyksCiAgICAgIGNvbnRvdXJzPWRpY3QoY29sb3Jpbmc9ImxpbmVzIiksCiAgICAgIGNvbG9yYmFyPWRpY3QodGl0bGU9IkxuKE1TRSBMb3NzKSIpLAogICAgICBsaW5lPWRpY3Qod2lkdGg9MikpCiAgXSwKICBsYXlvdXQ9Z28uTGF5b3V0KHRpdGxlPSJNU0UgTG9zcyBvbiBQYXJhbWV0ZXIgU3BhY2UiLAogICAgICAgICAgICAgICAgICAgeGF4aXM9dzFfYXhpcywgeWF4aXM9dzJfYXhpcywgc2hhcGVzPXNoYXBlcykpCmBgYAoKYGBge3IsIGVjaG89RkFMU0UsIGZpZy53aWR0aD0xMCwgZmlnLmhlaWdodD0xMH0KaHRtbHRvb2xzOjppbmNsdWRlSFRNTChweSRvZmlsZSkKYGBgCgpUaGUgY29uc3RyYWludCBjb25zdGFudCBjb250cm9sIHRoZSBzaXplIG9mIHJlZ3VsYXJpemF0aW9uLApmb3IgYSBsYXJnZXIgY29uc3RhbnQgKGxvb3NlciBjb25zdHJhaW50KSBvdXIgdGFnZW50IHBvaW50IHdpbGwgbW92ZSBjbG9zZXIgdG8gdGhlIHVucmVndWxhcml6ZWQgb3B0aW11bS4KRm9yIHRoaXMgZ2VvbWV0cmljIHBvaW50IG9mIHZpZXcsCm9uZSBzaG91bGQgYWxzbyByZWFsaXplIHRoYXQgc2luY2UgdGhlIEwxIHJlZ3VsYXJpemF0aW9uIGFyZWEgaXMgYSBzaGFycCBkaWFtb25kIHNxdWFyZSwKaXQgaXMgbW9yZSBsaWtlbHkgdG8gdGFuZ2VudCB0aGUgY29udG91ciBvbiB0aGUgZWRnZSB3aGljaCBleGFjdGx5IHJlcHJlc2VudCBhIHNwYXJzZSBzb2x1dGlvbiB0byB0aGUgd2VpZ2h0IChvbiBlYWNoIGVkZ2UgcG9pbnQgdGhlcmUgaXMgb25lIHdlaWdodCB6ZXJvZWQgb3V0KS4KCiMjIFByb2JhYmlsaXN0aWMgSW50ZXJwcmV0YXRpb24gb2YgTDEvTDIgUmVndWxhcml6YXRpb24KCklmIHdlIHRvb2sgYSBCYXllc2lhbiBhcHByb2FjaCBvbiB0aGUgd2VpZ2h0IGVzdGltYXRpb24sCnRoZSB0YXNrIGlzIHRvIHNvbHZlIGZvciB0aGUgcG9zdGVyaW9yIGRpc3RyaWJ1dGlvbiBvZiB3ZWlnaHQ6CgokJApQKFd8eSkgPSBcZnJhY3tQKHl8VykgXGNkb3QgUChXKX17UCh5KX0KXHByb3B0byAKUCh5fFcpIFxjZG90IFAoVykuCiQkCgp0aGVuIGEgTm9ybWFsIHByaW9yIG9uIHRoZSB3ZWlnaHQgJFcgXHNpbSBcbWJveHtOb3JtYWx9JCB3aWxsIHJlc3VsdCBpbiBhIG1heGltdW0gYSBwb3N0ZXJpb3JpIGVzdGltYXRvciB0byBoYXZlIGEgdGFyZ2V0IGZ1bmN0aW9uIHdpdGggdGhlIEwyIHJlZ3VsYXJpemF0aW9uIHRlcm0sCmFuZCBhIFtMYXBsYWNlYW5dKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0xhcGxhY2VfZGlzdHJpYnV0aW9uKSBwcmlvciAkVyBcc2ltIFxtYm94e0xhcGxhY2V9JCB3aWxsIHJlc3VsdCBpbiB0aGUgTDEgdGVybS4KClRoaXMgaXMgcXVpdGUgc3RyYWlnaHRmb3J3YXJkIGlmIHdlIHRha2UgYSBsb29rIGF0IHRoZSBwcm9iYWJpbGl0eSBkZW5zaXR5IGZ1bmN0aW9uIG9mIHRoZXNlIHR3byBkaXN0cmlidXRpb25zOgoKJCQKXGJlZ2lue2FsaWduZWR9ClxtYm94e05vcm1hbH0oXG11LCBcc2lnbWEpX1x0ZXh0e3BkZn0gJj0gZih3KSA9ClxmcmFjezF9e1xzcXJ0ezJccGlcc2lnbWFeMn19ZV57LVxmcmFjeyh3IC0gXG11KV4yfXsyXHNpZ21hXjJ9fSwgXFwKXG1ib3h7TGFwbGFjZX0oXG11LCBiKV9cdGV4dHtwZGZ9ICY9IGcodykgPQpcZnJhY3sxfXsyYn1lXnstXGZyYWN7XHZlcnQgdyAtIFxtdVx2ZXJ0fXtifX0uClxlbmR7YWxpZ25lZH0KJCQKCk5vdyBpZiB3ZSB3YW50IHRvIG1heGltaXplIHRoZSBsb2cgb2YgJFAoV3x5KSQgKG1heGltdW0gYSBwb3N0ZXJpb3JpKSwKdGhlIGdyYWRpZW50IHRvIHRoZSBsb2cgb2YgYSBOb3JtYWwgcHJpb3Igd2lsbCBnaXZlIHVzOgoKJCQKXGJlZ2lue2FsaWduZWR9ClxmcmFje1xwYXJ0aWFsIFxsbiBmKHcpfXtccGFydGlhbCB3fSAKJj0gXGZyYWN7XHBhcnRpYWwgXGJpZ2dbLVxmcmFjezF9ezJ9XGxuKDJccGlcc2lnbWFeMikgLSBcZnJhY3sodyAtIFxtdSleMn17MlxzaWdtYV4yfVxiaWdnXX17XHBhcnRpYWwgd30gXFwKJj0gLSBcZnJhY3sxfXtcc2lnbWFeMn0odyAtIFxtdSksClxlbmR7YWxpZ25lZH0KJCQKCmFuZCBmb3IgYSBMYXBsYWNlYW4gcHJpb3I6CgokJApcYmVnaW57YWxpZ25lZH0KXGZyYWN7XHBhcnRpYWwgXGxuIGcodyl9e1xwYXJ0aWFsIHd9IAomPSBcZnJhY3tccGFydGlhbCBcYmlnZ1stXGZyYWN7MX17MmJ9IC0gXGZyYWN7XHZlcnQgdyAtIFxtdSBcdmVydH17Yn1cYmlnZ119e1xwYXJ0aWFsIHd9IFxcCiY9IC0gXGZyYWN7MX17Yn1cZnJhY3t3fXtcdmVydCB3IFx2ZXJ0fS4KXGVuZHthbGlnbmVkfQokJAoKVGhlIHJlZ3VsYXJpemF0aW9uIGNvZWZmaWNpZW50IHdlIHByZXZpb3VzbHkgZGlzY3Vzc2VkIChoeXBlci1wYXJhbWV0ZXIgJFxsYW1iZGEkKSBjYW4gYmUgbWFwcGVkIHRvIHRoZSBjb25zdGFudCBvbiB0aGUgKHJlY2lwcm9jYWwgb2YpIHNjYWxlIHBhcmFtZXRlciBvZiB0aGUgQmF5ZXNpYW4gcHJpb3IuCkEgbGFyZ2VyICRcbGFtYmRhJCBjb3JyZXNwb25kcyB0byBhIHNtYWxsZXIgdmFyaWFuY2Ugb24gdGhlIHByaW9yLApoZW5jZSB0aGUgc2l6ZSBvZiB3ZWlnaHQgaXMgYmVpbmcgY29uc3RyYWluZWQgbW9yZSBpbiB0aGUgcG9zdGVyaW9yIGVzdGltYXRpb24sCnJlc3VsdGluZyBpbiBzbWFsbGVyIHdlaWdodC4KCldlIGNhbiBwbG90IHRoZSBzdGFuZGFyZGl6ZWQgTm9ybWFsIGFuZCBMYXBsYWNlIGRpc3RyaWJ1dGlvbiB0byBjbGVhcmx5IHNlZSB0aGVpciBkaWZmZXJlbmNlOgoKYGBge3B5dGhvbiBiYXllc2lhbl9wcmlvcl9wbG90fQpmcm9tIHNjaXB5LnN0YXRzIGltcG9ydCBsYXBsYWNlLCBub3JtCgp4dGlja3MgPSBucC5saW5zcGFjZSgtNSwgNSwgbnVtPTEwMDApCgpvZmlsZSA9ICJwbG90cy9yZWdfcHJpb3IuaHRtbCIKcCA9IHBsb3Rfb2ZmbGluZSgKICBvZmlsZT1vZmlsZSwKICBkYXRhPVtnby5TY2F0dGVyKHg9eHRpY2tzLCB5PWxhcGxhY2UucGRmKHh0aWNrcyksIG5hbWU9IkxhcGxhY2VhbiBQcmlvciAoTDEpIiksCiAgICAgICAgZ28uU2NhdHRlcih4PXh0aWNrcywgeT1ub3JtLnBkZih4dGlja3MpLCBuYW1lPSJOb3JtYWwgUHJpb3IgKEwyKSIpXSwKICBsYXlvdXQ9Z28uTGF5b3V0KAogICAgdGl0bGU9IkJheWVzaWFuIFByaW9yIG9uIE1vZGVsIFdlaWdodCIsCiAgICB4YXhpcz1kaWN0KHRpdGxlPSJNb2RlbCBXZWlnaHQiKSwKICAgIHlheGlzPWRpY3QodGl0bGU9IkRlbnNpdHkiKSkpCmBgYAoKYGBge3IsIGVjaG89RkFMU0V9Cmh0bWx0b29sczo6aW5jbHVkZUhUTUwocHkkb2ZpbGUpCmBgYAoKQ29tcGFyZWQgdG8gYSBOb3JtYWwgcHJpb3IsCmEgTGFwbGFjZWFuIHB1dCBtdWNoIG1vcmUgZGVuc2l0eSBhdCB0aGUgY2VudGVyLgpXaGVuIGJvdGggZGlzdHJpYnV0aW9uIGlzIHN0YW5kYXJkaXplZCAod2l0aCBsb2NhdGlvbiBhdCAwIGFuZCBzY2FsZSBhdCAxKSBhcyBqdXN0IHBsb3R0ZWQgYWJvdmUsCnRoaXMgY2FuIGJlIGludGVycHJldGVkIGFzIHRoYXQgYSBMYXBsYWNlYW4gcHJpb3IgaGFzIGEgc3Ryb25nZXIgcHJlZmVyZW5jZSBmb3IgYSBzcGFyc2Ugc29sdXRpb24gKHdlaWdodCA9IDApLgoKIyMgRHJvcG91dAoKQW5vdGhlciBtYXliZSBlYXNpZXIgd2F5IG9mIHJlZ3VsYXJpemF0aW9uIGlzIHRoZSBkcm9wb3V0IG1lY2hhbmlzbS4KSXQgaXMgZmlyc3QgaW50cm9kdWNlZCBpbiBhIG5ldXJhbCBuZXR3b3JrIG1vZGVsIGJ1dCBjYW4gYXBwbHkgdG8gc29tZSBvdGhlciBtYWNoaW5lIGxlYXJuaW5nIGFsZ29yaXRobXMgYXMgd2VsbCAoc3VjaCBhcyBncmFkaWVudCBib29zdGluZyB0cmVlcykuCg==